2026-09-30 17:43:09,261 [ 223449 ] INFO : ClickHouse root is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse (runner:42, check_args_and_update_paths) 2026-09-30 17:43:09,262 [ 223449 ] INFO : Cases dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:86, check_args_and_update_paths) 2026-09-30 17:43:09,262 [ 223449 ] INFO : utils dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/utils (runner:97, check_args_and_update_paths) 2026-09-30 17:43:09,262 [ 223449 ] INFO : base_configs_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/programs/server, binary: /home/ubuntu/_work/_temp/test/build/clickhouse, cases_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:99, check_args_and_update_paths) clickhouse_integration_tests_volume Running pytest container as: 'docker run --rm --name clickhouse_integration_tests_3y1263 --privileged --dns-search='.' --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-odbc-bridge:/clickhouse-odbc-bridge --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-library-bridge:/clickhouse-library-bridge --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=2cffe1eae894 -e DOCKER_BASE_TAG=b74d853ebe76 -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=caad4729259e -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-10-100000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-1000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-10000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-100000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-1000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-10000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-100000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-1000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-10000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-100000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-key-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-key-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-sipHash64(key)-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-sipHash64(key)-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-key-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-key-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-sipHash64(key)-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-sipHash64(key)-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-key-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-key-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-sipHash64(key)-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-sipHash64(key)-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-key-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-key-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-sipHash64(key)-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-sipHash64(key)-1]' test_relative_filepath/test.py::test_filepath test_reload_clusters_config/test.py::test_add_cluster test_reload_clusters_config/test.py::test_delete_cluster test_reload_clusters_config/test.py::test_simple_reload test_reload_clusters_config/test.py::test_update_one_cluster test_replica_can_become_leader/test.py::test_can_become_leader test_replica_is_active/test.py::test_replica_is_active test_replicated_merge_tree_thread_schedule_timeouts/test.py::test_query_exception_on_thread_pool_full test_replicated_zero_copy_projection_mutation/test.py::test_all_projection_files_are_dropped_when_part_is_dropped test_replicated_zero_copy_projection_mutation/test.py::test_hardlinks_preserved_when_projection_dropped test_restore_replica/test.py::test_restore_replica_alive_replicas test_restore_replica/test.py::test_restore_replica_invalid_tables test_restore_replica/test.py::test_restore_replica_parallel test_restore_replica/test.py::test_restore_replica_sequential test_s3_storage_class/test.py::test_s3_storage_class_right 'test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[None-zero_copy_lock_zk_fail_after_op]' 'test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[None-zero_copy_lock_zk_fail_before_op]' 'test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_after_op-zero_copy_lock_zk_fail_after_op]' 'test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_after_op-zero_copy_lock_zk_fail_before_op]' 'test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_before_op-zero_copy_lock_zk_fail_after_op]' 'test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_before_op-zero_copy_lock_zk_fail_before_op]' test_s3_zero_copy_replication/test.py::test_s3_zero_copy_concurrent_merge test_s3_zero_copy_replication/test.py::test_s3_zero_copy_drop_detached_alter test_s3_zero_copy_replication/test.py::test_s3_zero_copy_drop_detached_system test_s3_zero_copy_replication/test.py::test_s3_zero_copy_keeps_data_after_mutation 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_replication[s3]' test_s3_zero_copy_replication/test.py::test_s3_zero_copy_unfreeze_alter test_s3_zero_copy_replication/test.py::test_s3_zero_copy_unfreeze_system 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_delete[False-10]' 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_delete[True-3]' 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered-False-10]' 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered-True-3]' 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered_copy-False-10]' 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered_copy-True-3]' test_scheduler/test.py::test_merge_workload test_scheduler/test.py::test_merge_workload_change test_scheduler/test.py::test_merge_workload_override test_scheduler/test.py::test_mutate_workload test_scheduler/test.py::test_mutation_workload_change test_scheduler/test.py::test_mutation_workload_override test_scheduler/test.py::test_s3_disk test_secure_socket/test.py::test test_send_crash_reports/test.py::test_send_segfault test_server_initialization/test.py::test_partially_dropped_tables test_server_initialization/test.py::test_sophisticated_default test_server_start_and_ip_conversions/test.py::test_restart_success_ipv4 test_server_start_and_ip_conversions/test.py::test_restart_success_ipv6 test_storage_azure_blob_storage/test.py::test_azure_glob_scheherazade test_storage_azure_blob_storage/test.py::test_create_new_files_on_insert test_storage_azure_blob_storage/test.py::test_create_table_account_string test_storage_azure_blob_storage/test.py::test_create_table_connection_string test_storage_azure_blob_storage/test.py::test_filter_using_file test_storage_azure_blob_storage/test.py::test_filtering_by_file_or_path test_storage_azure_blob_storage/test.py::test_format_detection test_storage_azure_blob_storage/test.py::test_function_signatures test_storage_azure_blob_storage/test.py::test_hive_partitioning_with_all_parameters test_storage_azure_blob_storage/test.py::test_hive_partitioning_with_one_parameter test_storage_azure_blob_storage/test.py::test_hive_partitioning_without_setting test_storage_azure_blob_storage/test.py::test_insert_create_new_file test_storage_azure_blob_storage/test.py::test_insert_with_path_with_globs test_storage_azure_blob_storage/test.py::test_overwrite test_storage_azure_blob_storage/test.py::test_parallel_read test_storage_azure_blob_storage/test.py::test_partition_by test_storage_azure_blob_storage/test.py::test_partition_by_const_column test_storage_azure_blob_storage/test.py::test_partition_by_string_column -vvv" altinityinfra/integration-tests-runner:cf95077f4609 '. Start tests ============================= test session starts ============================== platform linux -- Python 3.10.12, pytest-7.4.4, pluggy-1.5.0 -- /usr/bin/python3 cachedir: .pytest_cache rootdir: /ClickHouse/tests/integration configfile: pytest.ini plugins: repeat-0.9.4, order-1.0.1, random-0.2, timeout-2.2.0, reportlog-0.4.0, xdist-3.5.0 timeout: 900.0s timeout method: signal timeout func_only: False created: 10/10 workers 10 workers [100 items] scheduling tests via LoadFileScheduling test_replicated_zero_copy_projection_mutation/test.py::test_all_projection_files_are_dropped_when_part_is_dropped test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-key-0] test_s3_zero_copy_replication/test.py::test_s3_zero_copy_replication[s3] test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-10-100000-SELECT sum(cityHash64(*)) FROM {table_name}] test_reload_clusters_config/test.py::test_add_cluster test_storage_azure_blob_storage/test.py::test_azure_glob_scheherazade test_server_start_and_ip_conversions/test.py::test_restart_success_ipv4 test_server_initialization/test.py::test_partially_dropped_tables test_scheduler/test.py::test_merge_workload test_restore_replica/test.py::test_restore_replica_alive_replicas [gw9] [ 1%] PASSED test_server_start_and_ip_conversions/test.py::test_restart_success_ipv4 test_server_start_and_ip_conversions/test.py::test_restart_success_ipv6 [gw5] [ 2%] PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-key-0] test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-key-1] [gw4] [ 3%] PASSED test_reload_clusters_config/test.py::test_add_cluster test_reload_clusters_config/test.py::test_delete_cluster [gw5] [ 4%] PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-key-1] test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-sipHash64(key)-0] [gw9] [ 5%] PASSED test_server_start_and_ip_conversions/test.py::test_restart_success_ipv6 [gw4] [ 6%] PASSED test_reload_clusters_config/test.py::test_delete_cluster test_reload_clusters_config/test.py::test_simple_reload [gw5] [ 7%] PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-sipHash64(key)-0] test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-sipHash64(key)-1] [gw4] [ 8%] PASSED test_reload_clusters_config/test.py::test_simple_reload test_reload_clusters_config/test.py::test_update_one_cluster test_replica_is_active/test.py::test_replica_is_active [gw5] [ 9%] PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-sipHash64(key)-1] test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-key-0] [gw4] [ 10%] PASSED test_reload_clusters_config/test.py::test_update_one_cluster [gw5] [ 11%] PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-key-0] test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-key-1] [gw5] [ 12%] PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-key-1] test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-sipHash64(key)-0] test_s3_storage_class/test.py::test_s3_storage_class_right [gw5] [ 13%] PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-sipHash64(key)-0] test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-sipHash64(key)-1] [gw5] [ 14%] PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-sipHash64(key)-1] test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-key-0] [gw5] [ 15%] PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-key-0] test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-key-1] [gw5] [ 16%] PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-key-1] test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-sipHash64(key)-0] [gw5] [ 17%] PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-sipHash64(key)-0] test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-sipHash64(key)-1] [gw5] [ 18%] PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-sipHash64(key)-1] test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-key-0] [gw5] [ 19%] PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-key-0] test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-key-1] [gw5] [ 20%] PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-key-1] test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-sipHash64(key)-0] [gw5] [ 21%] PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-sipHash64(key)-0] test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-sipHash64(key)-1] [gw5] [ 22%] PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-sipHash64(key)-1] [gw6] [ 23%] PASSED test_server_initialization/test.py::test_partially_dropped_tables test_server_initialization/test.py::test_sophisticated_default [gw1] [ 24%] PASSED test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-10-100000-SELECT sum(cityHash64(*)) FROM {table_name}] test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] [gw6] [ 25%] PASSED test_server_initialization/test.py::test_sophisticated_default [gw1] [ 26%] PASSED test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-1000-SELECT sum(cityHash64(*)) FROM {table_name}] [gw1] [ 27%] PASSED test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-1000-SELECT sum(cityHash64(*)) FROM {table_name}] test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] test_replica_can_become_leader/test.py::test_can_become_leader [gw8] [ 28%] PASSED test_restore_replica/test.py::test_restore_replica_alive_replicas test_restore_replica/test.py::test_restore_replica_invalid_tables [gw8] [ 29%] PASSED test_restore_replica/test.py::test_restore_replica_invalid_tables test_restore_replica/test.py::test_restore_replica_parallel [gw1] [ 30%] PASSED test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-10000-SELECT sum(cityHash64(*)) FROM {table_name}] [gw1] [ 31%] PASSED test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-10000-SELECT sum(cityHash64(*)) FROM {table_name}] test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] [gw1] [ 32%] PASSED test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-100000-SELECT sum(cityHash64(*)) FROM {table_name}] [gw1] [ 33%] PASSED test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-100000-SELECT sum(cityHash64(*)) FROM {table_name}] test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] [gw8] [ 34%] PASSED test_restore_replica/test.py::test_restore_replica_parallel test_restore_replica/test.py::test_restore_replica_sequential [gw1] [ 35%] PASSED test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-1000-SELECT sum(cityHash64(*)) FROM {table_name}] [gw1] [ 36%] PASSED test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-1000-SELECT sum(cityHash64(*)) FROM {table_name}] test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] [gw1] [ 37%] PASSED test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-10000-SELECT sum(cityHash64(*)) FROM {table_name}] [gw8] [ 38%] PASSED test_restore_replica/test.py::test_restore_replica_sequential [gw1] [ 39%] PASSED test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-10000-SELECT sum(cityHash64(*)) FROM {table_name}] test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] [gw1] [ 40%] PASSED test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-100000-SELECT sum(cityHash64(*)) FROM {table_name}] [gw1] [ 41%] PASSED test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-100000-SELECT sum(cityHash64(*)) FROM {table_name}] test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] [gw1] [ 42%] PASSED test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-1000-SELECT sum(cityHash64(*)) FROM {table_name}] [gw1] [ 43%] PASSED test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-1000-SELECT sum(cityHash64(*)) FROM {table_name}] test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] [gw1] [ 44%] PASSED test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-10000-SELECT sum(cityHash64(*)) FROM {table_name}] [gw1] [ 45%] PASSED test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-10000-SELECT sum(cityHash64(*)) FROM {table_name}] test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] [gw1] [ 46%] PASSED test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-100000-SELECT sum(cityHash64(*)) FROM {table_name}] [gw1] [ 47%] PASSED test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-100000-SELECT sum(cityHash64(*)) FROM {table_name}] [gw2] [ 48%] PASSED test_storage_azure_blob_storage/test.py::test_azure_glob_scheherazade test_storage_azure_blob_storage/test.py::test_create_new_files_on_insert [gw2] [ 49%] PASSED test_storage_azure_blob_storage/test.py::test_create_new_files_on_insert test_storage_azure_blob_storage/test.py::test_create_table_account_string [gw2] [ 50%] PASSED test_storage_azure_blob_storage/test.py::test_create_table_account_string test_storage_azure_blob_storage/test.py::test_create_table_connection_string [gw2] [ 51%] PASSED test_storage_azure_blob_storage/test.py::test_create_table_connection_string test_storage_azure_blob_storage/test.py::test_filter_using_file [gw2] [ 52%] PASSED test_storage_azure_blob_storage/test.py::test_filter_using_file test_storage_azure_blob_storage/test.py::test_filtering_by_file_or_path [gw2] [ 53%] PASSED test_storage_azure_blob_storage/test.py::test_filtering_by_file_or_path test_storage_azure_blob_storage/test.py::test_format_detection [gw2] [ 54%] PASSED test_storage_azure_blob_storage/test.py::test_format_detection test_storage_azure_blob_storage/test.py::test_function_signatures [gw2] [ 55%] PASSED test_storage_azure_blob_storage/test.py::test_function_signatures test_storage_azure_blob_storage/test.py::test_hive_partitioning_with_all_parameters [gw2] [ 56%] PASSED test_storage_azure_blob_storage/test.py::test_hive_partitioning_with_all_parameters test_storage_azure_blob_storage/test.py::test_hive_partitioning_with_one_parameter [gw2] [ 57%] PASSED test_storage_azure_blob_storage/test.py::test_hive_partitioning_with_one_parameter test_storage_azure_blob_storage/test.py::test_hive_partitioning_without_setting [gw2] [ 58%] PASSED test_storage_azure_blob_storage/test.py::test_hive_partitioning_without_setting test_storage_azure_blob_storage/test.py::test_insert_create_new_file [gw2] [ 59%] PASSED test_storage_azure_blob_storage/test.py::test_insert_create_new_file test_storage_azure_blob_storage/test.py::test_insert_with_path_with_globs [gw2] [ 60%] PASSED test_storage_azure_blob_storage/test.py::test_insert_with_path_with_globs test_storage_azure_blob_storage/test.py::test_overwrite [gw2] [ 61%] PASSED test_storage_azure_blob_storage/test.py::test_overwrite test_storage_azure_blob_storage/test.py::test_parallel_read [gw2] [ 62%] PASSED test_storage_azure_blob_storage/test.py::test_parallel_read test_storage_azure_blob_storage/test.py::test_partition_by [gw2] [ 63%] PASSED test_storage_azure_blob_storage/test.py::test_partition_by test_storage_azure_blob_storage/test.py::test_partition_by_const_column [gw2] [ 64%] PASSED test_storage_azure_blob_storage/test.py::test_partition_by_const_column test_storage_azure_blob_storage/test.py::test_partition_by_string_column [gw2] [ 65%] PASSED test_storage_azure_blob_storage/test.py::test_partition_by_string_column [gw9] [ 66%] PASSED test_replica_is_active/test.py::test_replica_is_active test_replicated_merge_tree_thread_schedule_timeouts/test.py::test_query_exception_on_thread_pool_full [gw6] [ 67%] PASSED test_replica_can_become_leader/test.py::test_can_become_leader [gw9] [ 68%] PASSED test_replicated_merge_tree_thread_schedule_timeouts/test.py::test_query_exception_on_thread_pool_full test_send_crash_reports/test.py::test_send_segfault [gw9] [ 69%] PASSED test_send_crash_reports/test.py::test_send_segfault [gw3] [ 70%] ERROR test_scheduler/test.py::test_merge_workload test_scheduler/test.py::test_merge_workload_change [gw3] [ 71%] ERROR test_scheduler/test.py::test_merge_workload_change test_scheduler/test.py::test_merge_workload_override [gw3] [ 72%] ERROR test_scheduler/test.py::test_merge_workload_override test_scheduler/test.py::test_mutate_workload [gw3] [ 73%] ERROR test_scheduler/test.py::test_mutate_workload test_scheduler/test.py::test_mutation_workload_change [gw3] [ 74%] ERROR test_scheduler/test.py::test_mutation_workload_change test_scheduler/test.py::test_mutation_workload_override [gw3] [ 75%] ERROR test_scheduler/test.py::test_mutation_workload_override test_scheduler/test.py::test_s3_disk [gw3] [ 76%] ERROR test_scheduler/test.py::test_s3_disk [gw4] [ 77%] ERROR test_s3_storage_class/test.py::test_s3_storage_class_right test_secure_socket/test.py::test [gw4] [ 78%] PASSED test_secure_socket/test.py::test [gw0] [ 79%] ERROR test_s3_zero_copy_replication/test.py::test_s3_zero_copy_replication[s3] test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[None-zero_copy_lock_zk_fail_after_op] [gw0] [ 80%] ERROR test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[None-zero_copy_lock_zk_fail_after_op] test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[None-zero_copy_lock_zk_fail_before_op] [gw0] [ 81%] ERROR test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[None-zero_copy_lock_zk_fail_before_op] test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_after_op-zero_copy_lock_zk_fail_after_op] [gw0] [ 82%] ERROR test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_after_op-zero_copy_lock_zk_fail_after_op] test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_after_op-zero_copy_lock_zk_fail_before_op] [gw0] [ 83%] ERROR test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_after_op-zero_copy_lock_zk_fail_before_op] test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_before_op-zero_copy_lock_zk_fail_after_op] [gw0] [ 84%] ERROR test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_before_op-zero_copy_lock_zk_fail_after_op] test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_before_op-zero_copy_lock_zk_fail_before_op] [gw0] [ 85%] ERROR test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_before_op-zero_copy_lock_zk_fail_before_op] test_s3_zero_copy_replication/test.py::test_s3_zero_copy_concurrent_merge [gw0] [ 86%] ERROR test_s3_zero_copy_replication/test.py::test_s3_zero_copy_concurrent_merge test_s3_zero_copy_replication/test.py::test_s3_zero_copy_drop_detached_alter [gw0] [ 87%] ERROR test_s3_zero_copy_replication/test.py::test_s3_zero_copy_drop_detached_alter test_s3_zero_copy_replication/test.py::test_s3_zero_copy_drop_detached_system [gw0] [ 88%] ERROR test_s3_zero_copy_replication/test.py::test_s3_zero_copy_drop_detached_system test_s3_zero_copy_replication/test.py::test_s3_zero_copy_keeps_data_after_mutation [gw0] [ 89%] ERROR test_s3_zero_copy_replication/test.py::test_s3_zero_copy_keeps_data_after_mutation test_s3_zero_copy_replication/test.py::test_s3_zero_copy_unfreeze_alter [gw0] [ 90%] ERROR test_s3_zero_copy_replication/test.py::test_s3_zero_copy_unfreeze_alter test_s3_zero_copy_replication/test.py::test_s3_zero_copy_unfreeze_system [gw0] [ 91%] ERROR test_s3_zero_copy_replication/test.py::test_s3_zero_copy_unfreeze_system test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_delete[False-10] [gw0] [ 92%] ERROR test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_delete[False-10] test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_delete[True-3] [gw0] [ 93%] ERROR test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_delete[True-3] test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered-False-10] [gw0] [ 94%] ERROR test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered-False-10] test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered-True-3] [gw0] [ 95%] ERROR test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered-True-3] test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered_copy-False-10] [gw0] [ 96%] ERROR test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered_copy-False-10] test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered_copy-True-3] [gw0] [ 97%] ERROR test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered_copy-True-3] [gw7] [ 98%] ERROR test_replicated_zero_copy_projection_mutation/test.py::test_all_projection_files_are_dropped_when_part_is_dropped test_replicated_zero_copy_projection_mutation/test.py::test_hardlinks_preserved_when_projection_dropped [gw7] [ 99%] ERROR test_replicated_zero_copy_projection_mutation/test.py::test_hardlinks_preserved_when_projection_dropped test_relative_filepath/test.py::test_filepath [gw7] [100%] PASSED test_relative_filepath/test.py::test_filepath ==================================== ERRORS ==================================== ____________________ ERROR at setup of test_merge_workload _____________________ [gw3] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_scheduler/test.py:31: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/.env', '--project-name', 'roottestscheduler_gw3', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/.env', '--project-name', 'roottestscheduler_gw3', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling resolver ... E Pulling node ... E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling resolver ... done E Pulling proxy2 ... done E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ---------------------------- Captured stdout setup ----------------------------- Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml ---------------------------- Captured stderr setup ----------------------------- Command:['docker ps | wc -l'] Command:['docker ps | wc -l'] Stdout:1 Stdout:1 No running containers No running containers Pruning Docker networks Pruning Docker networks Command:['docker network prune --force'] Command:['docker network prune --force'] Command:["sysctl net.ipv4.ip_local_port_range='55000 65535'"] Command:["sysctl net.ipv4.ip_local_port_range='55000 65535'"] Stdout:net.ipv4.ip_local_port_range = 55000 65535 Stdout:net.ipv4.ip_local_port_range = 55000 65535 Running tests in /ClickHouse/tests/integration/test_scheduler/test.py Running tests in /ClickHouse/tests/integration/test_scheduler/test.py Cluster start called. is_up=False Cluster start called. is_up=False Docker networks for project roottestscheduler_gw3 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestscheduler_gw3 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestscheduler_gw3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestscheduler_gw3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestscheduler_gw3 are DRIVER VOLUME NAME Docker volumes for project roottestscheduler_gw3 are DRIVER VOLUME NAME Cleanup called Cleanup called Docker networks for project roottestscheduler_gw3 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestscheduler_gw3 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestscheduler_gw3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestscheduler_gw3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestscheduler_gw3 are DRIVER VOLUME NAME Docker volumes for project roottestscheduler_gw3 are DRIVER VOLUME NAME Command:docker container list --all --filter name='^/roottestscheduler_gw3_.*_1$' --format '{{.ID}}:{{.Names}}' Command:docker container list --all --filter name='^/roottestscheduler_gw3_.*_1$' --format '{{.ID}}:{{.Names}}' Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestscheduler_gw3 No running containers for project: roottestscheduler_gw3 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused volumes... Trying to prune unused volumes... Command:['docker volume ls | wc -l'] Command:['docker volume ls | wc -l'] Stdout:1 Stdout:1 Setup directory for instance: node Setup directory for instance: node Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_scheduler/configs/storage_configuration.xml', '/ClickHouse/tests/integration/test_scheduler/configs/resources.xml', '/ClickHouse/tests/integration/test_scheduler/configs/resources.xml.default', '/ClickHouse/tests/integration/test_scheduler/configs/workloads.xml', '/ClickHouse/tests/integration/test_scheduler/configs/workloads.xml.default'] to /ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/node/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_scheduler/configs/storage_configuration.xml', '/ClickHouse/tests/integration/test_scheduler/configs/resources.xml', '/ClickHouse/tests/integration/test_scheduler/configs/resources.xml.default', '/ClickHouse/tests/integration/test_scheduler/configs/workloads.xml', '/ClickHouse/tests/integration/test_scheduler/configs/workloads.xml.default'] to /ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/node/configs/config.d Setup database dir /ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/node/database Setup database dir /ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/node/database Setup logs dir /ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/node/logs Setup logs dir /ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/node/logs Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon; coproc tail -f /dev/null; wait $$!" Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon; coproc tail -f /dev/null; wait $$!" Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/minio/certs/public.crt'} stored in /ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/minio/certs/public.crt'} stored in /ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/.env Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found http://localhost:None "GET /version HTTP/1.1" 200 825 http://localhost:None "GET /version HTTP/1.1" 200 825 Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/.env', '--project-name', 'roottestscheduler_gw3', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/.env', '--project-name', 'roottestscheduler_gw3', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] Stderr:Pulling proxy1 ... Stderr:Pulling proxy1 ... Stderr:Pulling proxy2 ... Stderr:Pulling proxy2 ... Stderr:Pulling minio1 ... Stderr:Pulling minio1 ... Stderr:Pulling node ... Stderr:Pulling node ... Stderr:Pulling resolver ... Stderr:Pulling resolver ... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling node ... pulling from altinityinfra/integr... Stderr:Pulling node ... pulling from altinityinfra/integr... Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling resolver ... done Stderr:Pulling resolver ... done Stderr:Pulling proxy2 ... done Stderr:Pulling proxy2 ... done Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node ... status: image is up to date for a... Stderr:Pulling node ... status: image is up to date for a... Stderr:Pulling proxy1 ... done Stderr:Pulling proxy1 ... done Stderr:Pulling node ... done Stderr:Pulling node ... done Stderr:Pulling minio1 ... error Stderr:Pulling minio1 ... error Stderr: Stderr: Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Exitcode:1 Exitcode:1 Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/.env', '--project-name', 'roottestscheduler_gw3', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling minio1 ... Pulling node ... Pulling resolver ... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling resolver ... done Pulling proxy2 ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling proxy1 ... done Pulling node ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/.env', '--project-name', 'roottestscheduler_gw3', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling minio1 ... Pulling node ... Pulling resolver ... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling resolver ... done Pulling proxy2 ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling proxy1 ... done Pulling node ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/.env', '--project-name', 'roottestscheduler_gw3', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/.env', '--project-name', 'roottestscheduler_gw3', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] Stderr:Pulling proxy2 ... Stderr:Pulling proxy2 ... Stderr:Pulling proxy1 ... Stderr:Pulling proxy1 ... Stderr:Pulling resolver ... Stderr:Pulling resolver ... Stderr:Pulling minio1 ... Stderr:Pulling minio1 ... Stderr:Pulling node ... Stderr:Pulling node ... Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling node ... pulling from altinityinfra/integr... Stderr:Pulling node ... pulling from altinityinfra/integr... Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... done Stderr:Pulling proxy1 ... done Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node ... status: image is up to date for a... Stderr:Pulling node ... status: image is up to date for a... Stderr:Pulling node ... done Stderr:Pulling node ... done Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... done Stderr:Pulling proxy2 ... done Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling resolver ... done Stderr:Pulling resolver ... done Stderr:Pulling minio1 ... error Stderr:Pulling minio1 ... error Stderr: Stderr: Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Exitcode:1 Exitcode:1 Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/.env', '--project-name', 'roottestscheduler_gw3', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling node ... pulling from altinityinfra/integr... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/.env', '--project-name', 'roottestscheduler_gw3', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling node ... pulling from altinityinfra/integr... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/.env', '--project-name', 'roottestscheduler_gw3', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/.env', '--project-name', 'roottestscheduler_gw3', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] Stderr:Pulling proxy2 ... Stderr:Pulling proxy2 ... Stderr:Pulling proxy1 ... Stderr:Pulling proxy1 ... Stderr:Pulling resolver ... Stderr:Pulling resolver ... Stderr:Pulling minio1 ... Stderr:Pulling minio1 ... Stderr:Pulling node ... Stderr:Pulling node ... Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... done Stderr:Pulling proxy2 ... done Stderr:Pulling node ... pulling from altinityinfra/integr... Stderr:Pulling node ... pulling from altinityinfra/integr... Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling resolver ... done Stderr:Pulling resolver ... done Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node ... status: image is up to date for a... Stderr:Pulling node ... status: image is up to date for a... Stderr:Pulling node ... done Stderr:Pulling node ... done Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... done Stderr:Pulling proxy1 ... done Stderr:Pulling minio1 ... error Stderr:Pulling minio1 ... error Stderr: Stderr: Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Exitcode:1 Exitcode:1 Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/.env', '--project-name', 'roottestscheduler_gw3', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling node ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/.env', '--project-name', 'roottestscheduler_gw3', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling node ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/.env', '--project-name', 'roottestscheduler_gw3', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/.env', '--project-name', 'roottestscheduler_gw3', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] Stderr:Pulling proxy1 ... Stderr:Pulling proxy1 ... Stderr:Pulling proxy2 ... Stderr:Pulling proxy2 ... Stderr:Pulling resolver ... Stderr:Pulling resolver ... Stderr:Pulling minio1 ... Stderr:Pulling minio1 ... Stderr:Pulling node ... Stderr:Pulling node ... Stderr:Pulling node ... pulling from altinityinfra/integr... Stderr:Pulling node ... pulling from altinityinfra/integr... Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node ... status: image is up to date for a... Stderr:Pulling node ... status: image is up to date for a... Stderr:Pulling node ... done Stderr:Pulling node ... done Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling proxy2 ... done Stderr:Pulling proxy2 ... done Stderr:Pulling proxy1 ... done Stderr:Pulling proxy1 ... done Stderr:Pulling resolver ... done Stderr:Pulling resolver ... done Stderr:Pulling minio1 ... error Stderr:Pulling minio1 ... error Stderr: Stderr: Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Exitcode:1 Exitcode:1 Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/.env', '--project-name', 'roottestscheduler_gw3', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling node ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling proxy2 ... done Pulling proxy1 ... done Pulling resolver ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/.env', '--project-name', 'roottestscheduler_gw3', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling node ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling proxy2 ... done Pulling proxy1 ... done Pulling resolver ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/.env', '--project-name', 'roottestscheduler_gw3', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/.env', '--project-name', 'roottestscheduler_gw3', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] Stderr:Pulling proxy2 ... Stderr:Pulling proxy2 ... Stderr:Pulling proxy1 ... Stderr:Pulling proxy1 ... Stderr:Pulling minio1 ... Stderr:Pulling minio1 ... Stderr:Pulling resolver ... Stderr:Pulling resolver ... Stderr:Pulling node ... Stderr:Pulling node ... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling node ... pulling from altinityinfra/integr... Stderr:Pulling node ... pulling from altinityinfra/integr... Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling resolver ... done Stderr:Pulling resolver ... done Stderr:Pulling proxy2 ... done Stderr:Pulling proxy2 ... done Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... done Stderr:Pulling proxy1 ... done Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node ... status: image is up to date for a... Stderr:Pulling node ... status: image is up to date for a... Stderr:Pulling node ... done Stderr:Pulling node ... done Stderr:Pulling minio1 ... error Stderr:Pulling minio1 ... error Stderr: Stderr: Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Exitcode:1 Exitcode:1 Failed to start cluster: Failed to start cluster: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/.env', '--project-name', 'roottestscheduler_gw3', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling minio1 ... Pulling resolver ... Pulling node ... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling resolver ... done Pulling proxy2 ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/.env', '--project-name', 'roottestscheduler_gw3', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling minio1 ... Pulling resolver ... Pulling node ... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling resolver ... done Pulling proxy2 ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Traceback (most recent call last): File "/ClickHouse/tests/integration/helpers/cluster.py", line 2831, in start retry(log_function=logging_pulling_images)(run_and_check)( File "/ClickHouse/tests/integration/helpers/retry_decorator.py", line 28, in wrapper raise e File "/ClickHouse/tests/integration/helpers/retry_decorator.py", line 19, in wrapper func(*args, **kwargs) File "/ClickHouse/tests/integration/helpers/cluster.py", line 129, in run_and_check raise Exception( Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/.env', '--project-name', 'roottestscheduler_gw3', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling minio1 ... Pulling resolver ... Pulling node ... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling resolver ... done Pulling proxy2 ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied None None docker-compose up was not called. Trying to export docker.log for running containers docker-compose up was not called. Trying to export docker.log for running containers Cleanup called Cleanup called Docker networks for project roottestscheduler_gw3 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestscheduler_gw3 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestscheduler_gw3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestscheduler_gw3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestscheduler_gw3 are DRIVER VOLUME NAME Docker volumes for project roottestscheduler_gw3 are DRIVER VOLUME NAME Command:docker container list --all --filter name='^/roottestscheduler_gw3_.*_1$' --format '{{.ID}}:{{.Names}}' Command:docker container list --all --filter name='^/roottestscheduler_gw3_.*_1$' --format '{{.ID}}:{{.Names}}' Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestscheduler_gw3 No running containers for project: roottestscheduler_gw3 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused volumes... Trying to prune unused volumes... Command:['docker volume ls | wc -l'] Command:['docker volume ls | wc -l'] Stdout:1 Stdout:1 docker-compose up was not called. Trying to export docker.log for running containers docker-compose up was not called. Trying to export docker.log for running containers Cleanup called Cleanup called Docker networks for project roottestscheduler_gw3 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestscheduler_gw3 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestscheduler_gw3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestscheduler_gw3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestscheduler_gw3 are DRIVER VOLUME NAME Docker volumes for project roottestscheduler_gw3 are DRIVER VOLUME NAME Command:docker container list --all --filter name='^/roottestscheduler_gw3_.*_1$' --format '{{.ID}}:{{.Names}}' Command:docker container list --all --filter name='^/roottestscheduler_gw3_.*_1$' --format '{{.ID}}:{{.Names}}' Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestscheduler_gw3 No running containers for project: roottestscheduler_gw3 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused volumes... Trying to prune unused volumes... Command:['docker volume ls | wc -l'] Command:['docker volume ls | wc -l'] Stdout:1 Stdout:1 ------------------------------ Captured log setup ------------------------------ 2026-09-30 17:43:14 [ 472 ] DEBUG : Command:['docker ps | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 17:43:14 [ 472 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-09-30 17:43:14 [ 472 ] DEBUG : No running containers (conftest.py:95, cleanup_environment) 2026-09-30 17:43:14 [ 472 ] DEBUG : Pruning Docker networks (conftest.py:97, cleanup_environment) 2026-09-30 17:43:14 [ 472 ] DEBUG : Command:['docker network prune --force'] (cluster.py:113, run_and_check) 2026-09-30 17:43:14 [ 472 ] DEBUG : Command:["sysctl net.ipv4.ip_local_port_range='55000 65535'"] (cluster.py:113, run_and_check) 2026-09-30 17:43:14 [ 472 ] DEBUG : Stdout:net.ipv4.ip_local_port_range = 55000 65535 (cluster.py:121, run_and_check) 2026-09-30 17:43:14 [ 472 ] INFO : Running tests in /ClickHouse/tests/integration/test_scheduler/test.py (cluster.py:2790, start) 2026-09-30 17:43:14 [ 472 ] DEBUG : Cluster start called. is_up=False (cluster.py:2797, start) 2026-09-30 17:43:14 [ 472 ] DEBUG : Docker networks for project roottestscheduler_gw3 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 17:43:14 [ 472 ] DEBUG : Docker containers for project roottestscheduler_gw3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 17:43:14 [ 472 ] DEBUG : Docker volumes for project roottestscheduler_gw3 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 17:43:14 [ 472 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 17:43:14 [ 472 ] DEBUG : Docker networks for project roottestscheduler_gw3 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 17:43:14 [ 472 ] DEBUG : Docker containers for project roottestscheduler_gw3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 17:43:14 [ 472 ] DEBUG : Docker volumes for project roottestscheduler_gw3 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 17:43:14 [ 472 ] DEBUG : Command:docker container list --all --filter name='^/roottestscheduler_gw3_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 17:43:14 [ 472 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 17:43:14 [ 472 ] DEBUG : No running containers for project: roottestscheduler_gw3 (cluster.py:904, cleanup) 2026-09-30 17:43:14 [ 472 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 17:43:14 [ 472 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 17:43:14 [ 472 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 17:43:14 [ 472 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-09-30 17:43:14 [ 472 ] DEBUG : Setup directory for instance: node (cluster.py:2810, start) 2026-09-30 17:43:14 [ 472 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4538, create_dir) 2026-09-30 17:43:14 [ 472 ] DEBUG : Create directory for common tests configuration (cluster.py:4543, create_dir) 2026-09-30 17:43:14 [ 472 ] DEBUG : Copy common configuration from helpers (cluster.py:4563, create_dir) 2026-09-30 17:43:14 [ 472 ] DEBUG : Generate and write macros file (cluster.py:4606, create_dir) 2026-09-30 17:43:14 [ 472 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_scheduler/configs/storage_configuration.xml', '/ClickHouse/tests/integration/test_scheduler/configs/resources.xml', '/ClickHouse/tests/integration/test_scheduler/configs/resources.xml.default', '/ClickHouse/tests/integration/test_scheduler/configs/workloads.xml', '/ClickHouse/tests/integration/test_scheduler/configs/workloads.xml.default'] to /ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/node/configs/config.d (cluster.py:4636, create_dir) 2026-09-30 17:43:14 [ 472 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/node/database (cluster.py:4653, create_dir) 2026-09-30 17:43:14 [ 472 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/node/logs (cluster.py:4664, create_dir) 2026-09-30 17:43:14 [ 472 ] DEBUG : Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon; coproc tail -f /dev/null; wait $$!" (cluster.py:4750, create_dir) 2026-09-30 17:43:14 [ 472 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/minio/certs/public.crt'} stored in /ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/.env (cluster.py:86, _create_env_file) 2026-09-30 17:43:14 [ 472 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-09-30 17:43:14 [ 472 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-09-30 17:43:14 [ 472 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-09-30 17:43:14 [ 472 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-09-30 17:43:14 [ 472 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 825 (connectionpool.py:547, _make_request) 2026-09-30 17:43:14 [ 472 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/.env', '--project-name', 'roottestscheduler_gw3', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 17:44:17 [ 472 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 17:44:17 [ 472 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 17:44:17 [ 472 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 17:44:17 [ 472 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-09-30 17:44:17 [ 472 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 17:44:17 [ 472 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 17:44:17 [ 472 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 17:44:17 [ 472 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 17:44:17 [ 472 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 17:44:17 [ 472 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 17:44:17 [ 472 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:44:17 [ 472 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 17:44:17 [ 472 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:44:17 [ 472 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 17:44:17 [ 472 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 17:44:17 [ 472 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 17:44:17 [ 472 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:44:17 [ 472 ] DEBUG : Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 17:44:17 [ 472 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:44:17 [ 472 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 17:44:17 [ 472 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-09-30 17:44:17 [ 472 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 17:44:17 [ 472 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 17:44:17 [ 472 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 17:44:17 [ 472 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 17:44:17 [ 472 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 17:44:17 [ 472 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/.env', '--project-name', 'roottestscheduler_gw3', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling minio1 ... Pulling node ... Pulling resolver ... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling resolver ... done Pulling proxy2 ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling proxy1 ... done Pulling node ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 17:44:19 [ 472 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/.env', '--project-name', 'roottestscheduler_gw3', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 17:45:22 [ 472 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 17:45:22 [ 472 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 17:45:22 [ 472 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 17:45:22 [ 472 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 17:45:22 [ 472 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-09-30 17:45:22 [ 472 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 17:45:22 [ 472 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 17:45:22 [ 472 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 17:45:22 [ 472 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 17:45:22 [ 472 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 17:45:22 [ 472 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:45:22 [ 472 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 17:45:22 [ 472 ] DEBUG : Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 17:45:22 [ 472 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:45:22 [ 472 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-09-30 17:45:22 [ 472 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 17:45:22 [ 472 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:45:22 [ 472 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 17:45:22 [ 472 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 17:45:22 [ 472 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:45:22 [ 472 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 17:45:22 [ 472 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 17:45:22 [ 472 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 17:45:22 [ 472 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 17:45:22 [ 472 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 17:45:22 [ 472 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 17:45:22 [ 472 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/.env', '--project-name', 'roottestscheduler_gw3', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling node ... pulling from altinityinfra/integr... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 17:45:25 [ 472 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/.env', '--project-name', 'roottestscheduler_gw3', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 17:46:26 [ 472 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 17:46:26 [ 472 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 17:46:26 [ 472 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 17:46:26 [ 472 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 17:46:26 [ 472 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-09-30 17:46:26 [ 472 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 17:46:26 [ 472 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 17:46:26 [ 472 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 17:46:26 [ 472 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:46:26 [ 472 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 17:46:26 [ 472 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 17:46:26 [ 472 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 17:46:26 [ 472 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:46:26 [ 472 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 17:46:26 [ 472 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 17:46:26 [ 472 ] DEBUG : Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 17:46:26 [ 472 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:46:26 [ 472 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-09-30 17:46:26 [ 472 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 17:46:26 [ 472 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:46:26 [ 472 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 17:46:26 [ 472 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 17:46:26 [ 472 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 17:46:26 [ 472 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 17:46:26 [ 472 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 17:46:26 [ 472 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 17:46:26 [ 472 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/.env', '--project-name', 'roottestscheduler_gw3', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling node ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 17:46:29 [ 472 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/.env', '--project-name', 'roottestscheduler_gw3', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 17:47:20 [ 472 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 17:47:20 [ 472 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 17:47:20 [ 472 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 17:47:20 [ 472 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 17:47:20 [ 472 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-09-30 17:47:20 [ 472 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 17:47:20 [ 472 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 17:47:20 [ 472 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 17:47:20 [ 472 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 17:47:20 [ 472 ] DEBUG : Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 17:47:20 [ 472 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:47:20 [ 472 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-09-30 17:47:20 [ 472 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 17:47:20 [ 472 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:47:20 [ 472 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 17:47:20 [ 472 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:47:20 [ 472 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 17:47:20 [ 472 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:47:20 [ 472 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 17:47:20 [ 472 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 17:47:20 [ 472 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 17:47:20 [ 472 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 17:47:20 [ 472 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 17:47:20 [ 472 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 17:47:20 [ 472 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 17:47:20 [ 472 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 17:47:20 [ 472 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/.env', '--project-name', 'roottestscheduler_gw3', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling node ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling proxy2 ... done Pulling proxy1 ... done Pulling resolver ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 17:47:24 [ 472 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/.env', '--project-name', 'roottestscheduler_gw3', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 17:48:12 [ 472 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 17:48:12 [ 472 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 17:48:12 [ 472 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 17:48:12 [ 472 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 17:48:12 [ 472 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-09-30 17:48:12 [ 472 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 17:48:12 [ 472 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 17:48:12 [ 472 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 17:48:12 [ 472 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 17:48:12 [ 472 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 17:48:12 [ 472 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:48:12 [ 472 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 17:48:12 [ 472 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:48:12 [ 472 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 17:48:12 [ 472 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 17:48:12 [ 472 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 17:48:12 [ 472 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:48:12 [ 472 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 17:48:12 [ 472 ] DEBUG : Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 17:48:12 [ 472 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:48:12 [ 472 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-09-30 17:48:12 [ 472 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 17:48:12 [ 472 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 17:48:12 [ 472 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 17:48:12 [ 472 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 17:48:12 [ 472 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 17:48:12 [ 472 ] DEBUG : Failed to start cluster: (cluster.py:3178, start) 2026-09-30 17:48:12 [ 472 ] DEBUG : Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/.env', '--project-name', 'roottestscheduler_gw3', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling minio1 ... Pulling resolver ... Pulling node ... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling resolver ... done Pulling proxy2 ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:3179, start) 2026-09-30 17:48:12 [ 472 ] DEBUG : None (cluster.py:3180, start) 2026-09-30 17:48:12 [ 472 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3246, shutdown) 2026-09-30 17:48:12 [ 472 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 17:48:12 [ 472 ] DEBUG : Docker networks for project roottestscheduler_gw3 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 17:48:12 [ 472 ] DEBUG : Docker containers for project roottestscheduler_gw3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 17:48:12 [ 472 ] DEBUG : Docker volumes for project roottestscheduler_gw3 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 17:48:12 [ 472 ] DEBUG : Command:docker container list --all --filter name='^/roottestscheduler_gw3_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 17:48:12 [ 472 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 17:48:12 [ 472 ] DEBUG : No running containers for project: roottestscheduler_gw3 (cluster.py:904, cleanup) 2026-09-30 17:48:12 [ 472 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 17:48:12 [ 472 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 17:48:12 [ 472 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 17:48:12 [ 472 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-09-30 17:48:12 [ 472 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3246, shutdown) 2026-09-30 17:48:12 [ 472 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 17:48:12 [ 472 ] DEBUG : Docker networks for project roottestscheduler_gw3 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 17:48:12 [ 472 ] DEBUG : Docker containers for project roottestscheduler_gw3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 17:48:12 [ 472 ] DEBUG : Docker volumes for project roottestscheduler_gw3 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 17:48:12 [ 472 ] DEBUG : Command:docker container list --all --filter name='^/roottestscheduler_gw3_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 17:48:12 [ 472 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 17:48:12 [ 472 ] DEBUG : No running containers for project: roottestscheduler_gw3 (cluster.py:904, cleanup) 2026-09-30 17:48:12 [ 472 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 17:48:12 [ 472 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 17:48:12 [ 472 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 17:48:12 [ 472 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) _________________ ERROR at setup of test_merge_workload_change _________________ [gw3] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_scheduler/test.py:31: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/.env', '--project-name', 'roottestscheduler_gw3', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/.env', '--project-name', 'roottestscheduler_gw3', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling resolver ... E Pulling node ... E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling resolver ... done E Pulling proxy2 ... done E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ________________ ERROR at setup of test_merge_workload_override ________________ [gw3] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_scheduler/test.py:31: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/.env', '--project-name', 'roottestscheduler_gw3', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/.env', '--project-name', 'roottestscheduler_gw3', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling resolver ... E Pulling node ... E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling resolver ... done E Pulling proxy2 ... done E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ____________________ ERROR at setup of test_mutate_workload ____________________ [gw3] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_scheduler/test.py:31: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/.env', '--project-name', 'roottestscheduler_gw3', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/.env', '--project-name', 'roottestscheduler_gw3', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling resolver ... E Pulling node ... E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling resolver ... done E Pulling proxy2 ... done E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _______________ ERROR at setup of test_mutation_workload_change ________________ [gw3] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_scheduler/test.py:31: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/.env', '--project-name', 'roottestscheduler_gw3', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/.env', '--project-name', 'roottestscheduler_gw3', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling resolver ... E Pulling node ... E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling resolver ... done E Pulling proxy2 ... done E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ______________ ERROR at setup of test_mutation_workload_override _______________ [gw3] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_scheduler/test.py:31: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/.env', '--project-name', 'roottestscheduler_gw3', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/.env', '--project-name', 'roottestscheduler_gw3', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling resolver ... E Pulling node ... E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling resolver ... done E Pulling proxy2 ... done E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ________________________ ERROR at setup of test_s3_disk ________________________ [gw3] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_scheduler/test.py:31: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/.env', '--project-name', 'roottestscheduler_gw3', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/.env', '--project-name', 'roottestscheduler_gw3', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling resolver ... E Pulling node ... E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling resolver ... done E Pulling proxy2 ... done E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ________________ ERROR at setup of test_s3_storage_class_right _________________ [gw4] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: > cluster.start() test_s3_storage_class/test.py:22: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/.env', '--project-name', 'roottests3storageclass_gw4', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/.env', '--project-name', 'roottests3storageclass_gw4', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling proxy2 ... E Pulling minio1 ... E Pulling node ... E Pulling resolver ... E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling node ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ---------------------------- Captured stdout setup ----------------------------- Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml ---------------------------- Captured stderr setup ----------------------------- Running tests in /ClickHouse/tests/integration/test_s3_storage_class/test.py Running tests in /ClickHouse/tests/integration/test_s3_storage_class/test.py Cluster start called. is_up=False Cluster start called. is_up=False Docker networks for project roottests3storageclass_gw4 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3storageclass_gw4 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottests3storageclass_gw4 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3storageclass_gw4 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottests3storageclass_gw4 are DRIVER VOLUME NAME Docker volumes for project roottests3storageclass_gw4 are DRIVER VOLUME NAME Cleanup called Cleanup called Docker networks for project roottests3storageclass_gw4 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3storageclass_gw4 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottests3storageclass_gw4 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3storageclass_gw4 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottests3storageclass_gw4 are DRIVER VOLUME NAME Docker volumes for project roottests3storageclass_gw4 are DRIVER VOLUME NAME Command:docker container list --all --filter name='^/roottests3storageclass_gw4_.*_1$' --format '{{.ID}}:{{.Names}}' Command:docker container list --all --filter name='^/roottests3storageclass_gw4_.*_1$' --format '{{.ID}}:{{.Names}}' Unstopped containers: {} Unstopped containers: {} No running containers for project: roottests3storageclass_gw4 No running containers for project: roottests3storageclass_gw4 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused volumes... Trying to prune unused volumes... Command:['docker volume ls | wc -l'] Command:['docker volume ls | wc -l'] Stdout:3 Stdout:3 Setup directory for instance: node Setup directory for instance: node Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_s3_storage_class/configs/config.d/minio.xml'] to /ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/node/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_s3_storage_class/configs/config.d/minio.xml'] to /ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/node/configs/config.d Setup database dir /ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/node/database Setup database dir /ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/node/database Setup logs dir /ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/node/logs Setup logs dir /ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/node/logs Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon; coproc tail -f /dev/null; wait $$!" Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon; coproc tail -f /dev/null; wait $$!" Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/minio/certs/public.crt'} stored in /ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/minio/certs/public.crt'} stored in /ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/.env Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found http://localhost:None "GET /version HTTP/1.1" 200 825 http://localhost:None "GET /version HTTP/1.1" 200 825 Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/.env', '--project-name', 'roottests3storageclass_gw4', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/.env', '--project-name', 'roottests3storageclass_gw4', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] Stderr:Pulling proxy2 ... Stderr:Pulling proxy2 ... Stderr:Pulling proxy1 ... Stderr:Pulling proxy1 ... Stderr:Pulling resolver ... Stderr:Pulling resolver ... Stderr:Pulling minio1 ... Stderr:Pulling minio1 ... Stderr:Pulling node ... Stderr:Pulling node ... Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling node ... pulling from altinityinfra/integr... Stderr:Pulling node ... pulling from altinityinfra/integr... Stderr:Pulling proxy2 ... done Stderr:Pulling proxy2 ... done Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling resolver ... done Stderr:Pulling resolver ... done Stderr:Pulling proxy1 ... done Stderr:Pulling proxy1 ... done Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node ... status: image is up to date for a... Stderr:Pulling node ... status: image is up to date for a... Stderr:Pulling node ... done Stderr:Pulling node ... done Stderr:Pulling minio1 ... error Stderr:Pulling minio1 ... error Stderr: Stderr: Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Exitcode:1 Exitcode:1 Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/.env', '--project-name', 'roottests3storageclass_gw4', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling node ... pulling from altinityinfra/integr... Pulling proxy2 ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling resolver ... done Pulling proxy1 ... done Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/.env', '--project-name', 'roottests3storageclass_gw4', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling node ... pulling from altinityinfra/integr... Pulling proxy2 ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling resolver ... done Pulling proxy1 ... done Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/.env', '--project-name', 'roottests3storageclass_gw4', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/.env', '--project-name', 'roottests3storageclass_gw4', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] Stderr:Pulling proxy1 ... Stderr:Pulling proxy1 ... Stderr:Pulling proxy2 ... Stderr:Pulling proxy2 ... Stderr:Pulling resolver ... Stderr:Pulling resolver ... Stderr:Pulling minio1 ... Stderr:Pulling minio1 ... Stderr:Pulling node ... Stderr:Pulling node ... Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling node ... pulling from altinityinfra/integr... Stderr:Pulling node ... pulling from altinityinfra/integr... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... done Stderr:Pulling proxy2 ... done Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node ... status: image is up to date for a... Stderr:Pulling node ... status: image is up to date for a... Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling node ... done Stderr:Pulling node ... done Stderr:Pulling resolver ... done Stderr:Pulling resolver ... done Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... done Stderr:Pulling proxy1 ... done Stderr:Pulling minio1 ... error Stderr:Pulling minio1 ... error Stderr: Stderr: Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Exitcode:1 Exitcode:1 Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/.env', '--project-name', 'roottests3storageclass_gw4', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling node ... done Pulling resolver ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/.env', '--project-name', 'roottests3storageclass_gw4', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling node ... done Pulling resolver ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/.env', '--project-name', 'roottests3storageclass_gw4', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/.env', '--project-name', 'roottests3storageclass_gw4', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] Stderr:Pulling proxy1 ... Stderr:Pulling proxy1 ... Stderr:Pulling proxy2 ... Stderr:Pulling proxy2 ... Stderr:Pulling minio1 ... Stderr:Pulling minio1 ... Stderr:Pulling node ... Stderr:Pulling node ... Stderr:Pulling resolver ... Stderr:Pulling resolver ... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling node ... pulling from altinityinfra/integr... Stderr:Pulling node ... pulling from altinityinfra/integr... Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling resolver ... done Stderr:Pulling resolver ... done Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling node ... status: image is up to date for a... Stderr:Pulling node ... status: image is up to date for a... Stderr:Pulling node ... done Stderr:Pulling node ... done Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... done Stderr:Pulling proxy1 ... done Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... done Stderr:Pulling proxy2 ... done Stderr:Pulling minio1 ... error Stderr:Pulling minio1 ... error Stderr: Stderr: Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Exitcode:1 Exitcode:1 Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/.env', '--project-name', 'roottests3storageclass_gw4', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling minio1 ... Pulling node ... Pulling resolver ... Pulling resolver ... pulling from altinityinfra/python... Pulling node ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node ... status: image is up to date for a... Pulling node ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/.env', '--project-name', 'roottests3storageclass_gw4', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling minio1 ... Pulling node ... Pulling resolver ... Pulling resolver ... pulling from altinityinfra/python... Pulling node ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node ... status: image is up to date for a... Pulling node ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/.env', '--project-name', 'roottests3storageclass_gw4', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/.env', '--project-name', 'roottests3storageclass_gw4', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] Stderr:Pulling proxy2 ... Stderr:Pulling proxy2 ... Stderr:Pulling proxy1 ... Stderr:Pulling proxy1 ... Stderr:Pulling minio1 ... Stderr:Pulling minio1 ... Stderr:Pulling node ... Stderr:Pulling node ... Stderr:Pulling resolver ... Stderr:Pulling resolver ... Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling node ... pulling from altinityinfra/integr... Stderr:Pulling node ... pulling from altinityinfra/integr... Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... done Stderr:Pulling proxy2 ... done Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node ... status: image is up to date for a... Stderr:Pulling node ... status: image is up to date for a... Stderr:Pulling resolver ... done Stderr:Pulling resolver ... done Stderr:Pulling proxy1 ... done Stderr:Pulling proxy1 ... done Stderr:Pulling node ... done Stderr:Pulling node ... done Stderr:Pulling minio1 ... error Stderr:Pulling minio1 ... error Stderr: Stderr: Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Exitcode:1 Exitcode:1 Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/.env', '--project-name', 'roottests3storageclass_gw4', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling minio1 ... Pulling node ... Pulling resolver ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling node ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling resolver ... done Pulling proxy1 ... done Pulling node ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/.env', '--project-name', 'roottests3storageclass_gw4', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling minio1 ... Pulling node ... Pulling resolver ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling node ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling resolver ... done Pulling proxy1 ... done Pulling node ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/.env', '--project-name', 'roottests3storageclass_gw4', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/.env', '--project-name', 'roottests3storageclass_gw4', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] Stderr:Pulling proxy1 ... Stderr:Pulling proxy1 ... Stderr:Pulling proxy2 ... Stderr:Pulling proxy2 ... Stderr:Pulling minio1 ... Stderr:Pulling minio1 ... Stderr:Pulling node ... Stderr:Pulling node ... Stderr:Pulling resolver ... Stderr:Pulling resolver ... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling resolver ... done Stderr:Pulling resolver ... done Stderr:Pulling node ... pulling from altinityinfra/integr... Stderr:Pulling node ... pulling from altinityinfra/integr... Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... done Stderr:Pulling proxy2 ... done Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node ... status: image is up to date for a... Stderr:Pulling node ... status: image is up to date for a... Stderr:Pulling node ... done Stderr:Pulling node ... done Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... done Stderr:Pulling proxy1 ... done Stderr:Pulling minio1 ... error Stderr:Pulling minio1 ... error Stderr: Stderr: Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Exitcode:1 Exitcode:1 Failed to start cluster: Failed to start cluster: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/.env', '--project-name', 'roottests3storageclass_gw4', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling minio1 ... Pulling node ... Pulling resolver ... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling node ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/.env', '--project-name', 'roottests3storageclass_gw4', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling minio1 ... Pulling node ... Pulling resolver ... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling node ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Traceback (most recent call last): File "/ClickHouse/tests/integration/helpers/cluster.py", line 2831, in start retry(log_function=logging_pulling_images)(run_and_check)( File "/ClickHouse/tests/integration/helpers/retry_decorator.py", line 28, in wrapper raise e File "/ClickHouse/tests/integration/helpers/retry_decorator.py", line 19, in wrapper func(*args, **kwargs) File "/ClickHouse/tests/integration/helpers/cluster.py", line 129, in run_and_check raise Exception( Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/.env', '--project-name', 'roottests3storageclass_gw4', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling minio1 ... Pulling node ... Pulling resolver ... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling node ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied None None docker-compose up was not called. Trying to export docker.log for running containers docker-compose up was not called. Trying to export docker.log for running containers Cleanup called Cleanup called Docker networks for project roottests3storageclass_gw4 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3storageclass_gw4 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottests3storageclass_gw4 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3storageclass_gw4 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottests3storageclass_gw4 are DRIVER VOLUME NAME Docker volumes for project roottests3storageclass_gw4 are DRIVER VOLUME NAME Command:docker container list --all --filter name='^/roottests3storageclass_gw4_.*_1$' --format '{{.ID}}:{{.Names}}' Command:docker container list --all --filter name='^/roottests3storageclass_gw4_.*_1$' --format '{{.ID}}:{{.Names}}' Unstopped containers: {} Unstopped containers: {} No running containers for project: roottests3storageclass_gw4 No running containers for project: roottests3storageclass_gw4 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused volumes... Trying to prune unused volumes... Command:['docker volume ls | wc -l'] Command:['docker volume ls | wc -l'] Stdout:1 Stdout:1 docker-compose up was not called. Trying to export docker.log for running containers docker-compose up was not called. Trying to export docker.log for running containers Cleanup called Cleanup called Docker networks for project roottests3storageclass_gw4 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3storageclass_gw4 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottests3storageclass_gw4 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3storageclass_gw4 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottests3storageclass_gw4 are DRIVER VOLUME NAME Docker volumes for project roottests3storageclass_gw4 are DRIVER VOLUME NAME Command:docker container list --all --filter name='^/roottests3storageclass_gw4_.*_1$' --format '{{.ID}}:{{.Names}}' Command:docker container list --all --filter name='^/roottests3storageclass_gw4_.*_1$' --format '{{.ID}}:{{.Names}}' Unstopped containers: {} Unstopped containers: {} No running containers for project: roottests3storageclass_gw4 No running containers for project: roottests3storageclass_gw4 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused volumes... Trying to prune unused volumes... Command:['docker volume ls | wc -l'] Command:['docker volume ls | wc -l'] Stdout:1 Stdout:1 ------------------------------ Captured log setup ------------------------------ 2026-09-30 17:44:28 [ 475 ] INFO : Running tests in /ClickHouse/tests/integration/test_s3_storage_class/test.py (cluster.py:2790, start) 2026-09-30 17:44:28 [ 475 ] DEBUG : Cluster start called. is_up=False (cluster.py:2797, start) 2026-09-30 17:44:28 [ 475 ] DEBUG : Docker networks for project roottests3storageclass_gw4 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 17:44:28 [ 475 ] DEBUG : Docker containers for project roottests3storageclass_gw4 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 17:44:28 [ 475 ] DEBUG : Docker volumes for project roottests3storageclass_gw4 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 17:44:28 [ 475 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 17:44:28 [ 475 ] DEBUG : Docker networks for project roottests3storageclass_gw4 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 17:44:28 [ 475 ] DEBUG : Docker containers for project roottests3storageclass_gw4 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 17:44:28 [ 475 ] DEBUG : Docker volumes for project roottests3storageclass_gw4 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 17:44:28 [ 475 ] DEBUG : Command:docker container list --all --filter name='^/roottests3storageclass_gw4_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 17:44:28 [ 475 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 17:44:28 [ 475 ] DEBUG : No running containers for project: roottests3storageclass_gw4 (cluster.py:904, cleanup) 2026-09-30 17:44:28 [ 475 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 17:44:28 [ 475 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 17:44:28 [ 475 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 17:44:28 [ 475 ] DEBUG : Stdout:3 (cluster.py:121, run_and_check) 2026-09-30 17:44:28 [ 475 ] DEBUG : Setup directory for instance: node (cluster.py:2810, start) 2026-09-30 17:44:28 [ 475 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4538, create_dir) 2026-09-30 17:44:28 [ 475 ] DEBUG : Create directory for common tests configuration (cluster.py:4543, create_dir) 2026-09-30 17:44:28 [ 475 ] DEBUG : Copy common configuration from helpers (cluster.py:4563, create_dir) 2026-09-30 17:44:28 [ 475 ] DEBUG : Generate and write macros file (cluster.py:4606, create_dir) 2026-09-30 17:44:28 [ 475 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_s3_storage_class/configs/config.d/minio.xml'] to /ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/node/configs/config.d (cluster.py:4636, create_dir) 2026-09-30 17:44:28 [ 475 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/node/database (cluster.py:4653, create_dir) 2026-09-30 17:44:28 [ 475 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/node/logs (cluster.py:4664, create_dir) 2026-09-30 17:44:28 [ 475 ] DEBUG : Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon; coproc tail -f /dev/null; wait $$!" (cluster.py:4750, create_dir) 2026-09-30 17:44:28 [ 475 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/minio/certs/public.crt'} stored in /ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/.env (cluster.py:86, _create_env_file) 2026-09-30 17:44:28 [ 475 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-09-30 17:44:28 [ 475 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-09-30 17:44:28 [ 475 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-09-30 17:44:28 [ 475 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-09-30 17:44:28 [ 475 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 825 (connectionpool.py:547, _make_request) 2026-09-30 17:44:28 [ 475 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/.env', '--project-name', 'roottests3storageclass_gw4', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 17:45:22 [ 475 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 17:45:22 [ 475 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 17:45:22 [ 475 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 17:45:22 [ 475 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 17:45:22 [ 475 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-09-30 17:45:22 [ 475 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 17:45:22 [ 475 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 17:45:22 [ 475 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 17:45:22 [ 475 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 17:45:22 [ 475 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:45:22 [ 475 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 17:45:22 [ 475 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 17:45:22 [ 475 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 17:45:22 [ 475 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:45:22 [ 475 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 17:45:22 [ 475 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:45:22 [ 475 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 17:45:22 [ 475 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 17:45:22 [ 475 ] DEBUG : Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 17:45:22 [ 475 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:45:22 [ 475 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-09-30 17:45:22 [ 475 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 17:45:22 [ 475 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 17:45:22 [ 475 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 17:45:22 [ 475 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 17:45:22 [ 475 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 17:45:22 [ 475 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/.env', '--project-name', 'roottests3storageclass_gw4', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling node ... pulling from altinityinfra/integr... Pulling proxy2 ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling resolver ... done Pulling proxy1 ... done Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 17:45:23 [ 475 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/.env', '--project-name', 'roottests3storageclass_gw4', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 17:46:26 [ 475 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 17:46:26 [ 475 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 17:46:26 [ 475 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 17:46:26 [ 475 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 17:46:26 [ 475 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-09-30 17:46:26 [ 475 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 17:46:26 [ 475 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 17:46:26 [ 475 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 17:46:26 [ 475 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 17:46:26 [ 475 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:46:26 [ 475 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 17:46:26 [ 475 ] DEBUG : Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 17:46:26 [ 475 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:46:26 [ 475 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 17:46:26 [ 475 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:46:26 [ 475 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-09-30 17:46:26 [ 475 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 17:46:26 [ 475 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 17:46:26 [ 475 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 17:46:26 [ 475 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:46:26 [ 475 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 17:46:26 [ 475 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 17:46:26 [ 475 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 17:46:26 [ 475 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 17:46:26 [ 475 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 17:46:26 [ 475 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 17:46:26 [ 475 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/.env', '--project-name', 'roottests3storageclass_gw4', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling node ... done Pulling resolver ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 17:46:29 [ 475 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/.env', '--project-name', 'roottests3storageclass_gw4', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 17:47:20 [ 475 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 17:47:20 [ 475 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 17:47:20 [ 475 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 17:47:20 [ 475 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-09-30 17:47:20 [ 475 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 17:47:20 [ 475 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 17:47:20 [ 475 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 17:47:20 [ 475 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 17:47:20 [ 475 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:47:20 [ 475 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 17:47:20 [ 475 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 17:47:20 [ 475 ] DEBUG : Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 17:47:20 [ 475 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 17:47:20 [ 475 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:47:20 [ 475 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-09-30 17:47:20 [ 475 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 17:47:20 [ 475 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:47:20 [ 475 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 17:47:20 [ 475 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 17:47:20 [ 475 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:47:20 [ 475 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 17:47:20 [ 475 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 17:47:20 [ 475 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 17:47:20 [ 475 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 17:47:20 [ 475 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 17:47:20 [ 475 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 17:47:20 [ 475 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/.env', '--project-name', 'roottests3storageclass_gw4', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling minio1 ... Pulling node ... Pulling resolver ... Pulling resolver ... pulling from altinityinfra/python... Pulling node ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node ... status: image is up to date for a... Pulling node ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 17:47:24 [ 475 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/.env', '--project-name', 'roottests3storageclass_gw4', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 17:48:12 [ 475 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 17:48:12 [ 475 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 17:48:12 [ 475 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 17:48:12 [ 475 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-09-30 17:48:12 [ 475 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 17:48:12 [ 475 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 17:48:12 [ 475 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 17:48:12 [ 475 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 17:48:12 [ 475 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 17:48:12 [ 475 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 17:48:12 [ 475 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:48:12 [ 475 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 17:48:12 [ 475 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 17:48:12 [ 475 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:48:12 [ 475 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 17:48:12 [ 475 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:48:12 [ 475 ] DEBUG : Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 17:48:12 [ 475 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:48:12 [ 475 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 17:48:12 [ 475 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 17:48:12 [ 475 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-09-30 17:48:12 [ 475 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 17:48:12 [ 475 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 17:48:12 [ 475 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 17:48:12 [ 475 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 17:48:12 [ 475 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 17:48:12 [ 475 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/.env', '--project-name', 'roottests3storageclass_gw4', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling minio1 ... Pulling node ... Pulling resolver ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling node ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling resolver ... done Pulling proxy1 ... done Pulling node ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 17:48:16 [ 475 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/.env', '--project-name', 'roottests3storageclass_gw4', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 17:49:09 [ 475 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 17:49:09 [ 475 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 17:49:09 [ 475 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 17:49:09 [ 475 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-09-30 17:49:09 [ 475 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 17:49:09 [ 475 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 17:49:09 [ 475 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 17:49:09 [ 475 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 17:49:09 [ 475 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:49:09 [ 475 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 17:49:09 [ 475 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 17:49:09 [ 475 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 17:49:09 [ 475 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:49:09 [ 475 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 17:49:09 [ 475 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 17:49:09 [ 475 ] DEBUG : Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 17:49:09 [ 475 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:49:09 [ 475 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-09-30 17:49:09 [ 475 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 17:49:09 [ 475 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:49:09 [ 475 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 17:49:09 [ 475 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 17:49:09 [ 475 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 17:49:09 [ 475 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 17:49:09 [ 475 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 17:49:09 [ 475 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 17:49:09 [ 475 ] DEBUG : Failed to start cluster: (cluster.py:3178, start) 2026-09-30 17:49:09 [ 475 ] DEBUG : Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/.env', '--project-name', 'roottests3storageclass_gw4', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling minio1 ... Pulling node ... Pulling resolver ... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling node ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:3179, start) 2026-09-30 17:49:09 [ 475 ] DEBUG : None (cluster.py:3180, start) 2026-09-30 17:49:09 [ 475 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3246, shutdown) 2026-09-30 17:49:09 [ 475 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 17:49:09 [ 475 ] DEBUG : Docker networks for project roottests3storageclass_gw4 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 17:49:09 [ 475 ] DEBUG : Docker containers for project roottests3storageclass_gw4 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 17:49:09 [ 475 ] DEBUG : Docker volumes for project roottests3storageclass_gw4 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 17:49:09 [ 475 ] DEBUG : Command:docker container list --all --filter name='^/roottests3storageclass_gw4_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 17:49:09 [ 475 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 17:49:09 [ 475 ] DEBUG : No running containers for project: roottests3storageclass_gw4 (cluster.py:904, cleanup) 2026-09-30 17:49:09 [ 475 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 17:49:09 [ 475 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 17:49:09 [ 475 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 17:49:09 [ 475 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-09-30 17:49:09 [ 475 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3246, shutdown) 2026-09-30 17:49:09 [ 475 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 17:49:09 [ 475 ] DEBUG : Docker networks for project roottests3storageclass_gw4 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 17:49:09 [ 475 ] DEBUG : Docker containers for project roottests3storageclass_gw4 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 17:49:09 [ 475 ] DEBUG : Docker volumes for project roottests3storageclass_gw4 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 17:49:09 [ 475 ] DEBUG : Command:docker container list --all --filter name='^/roottests3storageclass_gw4_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 17:49:09 [ 475 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 17:49:09 [ 475 ] DEBUG : No running containers for project: roottests3storageclass_gw4 (cluster.py:904, cleanup) 2026-09-30 17:49:09 [ 475 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 17:49:09 [ 475 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 17:49:09 [ 475 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 17:49:09 [ 475 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) _____________ ERROR at setup of test_s3_zero_copy_replication[s3] ______________ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster.add_instance( "node1", main_configs=["configs/config.d/s3.xml"], macros={"replica": "1"}, with_minio=True, with_zookeeper=True, ) cluster.add_instance( "node2", main_configs=["configs/config.d/s3.xml"], macros={"replica": "2"}, with_minio=True, with_zookeeper=True, ) logging.info("Starting cluster...") > cluster.start() test_s3_zero_copy_replication/test.py:34: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling zoo3 ... E Pulling zoo2 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling minio1 ... E Pulling node1 ... E Pulling node2 ... E Pulling resolver ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling node1 ... digest: sha256:2ea9da862c215fd684... E Pulling node1 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling node1 ... done E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling node2 ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling node2 ... digest: sha256:2ea9da862c215fd684... E Pulling node2 ... status: image is up to date for a... E Pulling node2 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ---------------------------- Captured stdout setup ----------------------------- Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml ---------------------------- Captured stderr setup ----------------------------- Command:['docker ps | wc -l'] Command:['docker ps | wc -l'] Stdout:1 Stdout:1 No running containers No running containers Pruning Docker networks Pruning Docker networks Command:['docker network prune --force'] Command:['docker network prune --force'] Command:["sysctl net.ipv4.ip_local_port_range='55000 65535'"] Command:["sysctl net.ipv4.ip_local_port_range='55000 65535'"] Stdout:net.ipv4.ip_local_port_range = 55000 65535 Stdout:net.ipv4.ip_local_port_range = 55000 65535 clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log Setup Keeper Setup Keeper Cluster name: project_name:roottests3zerocopyreplication_gw0. Added instance name:node1 tag:b74d853ebe76 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ Cluster name: project_name:roottests3zerocopyreplication_gw0. Added instance name:node1 tag:b74d853ebe76 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log Cluster name: project_name:roottests3zerocopyreplication_gw0. Added instance name:node2 tag:b74d853ebe76 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ Cluster name: project_name:roottests3zerocopyreplication_gw0. Added instance name:node2 tag:b74d853ebe76 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ Starting cluster... Starting cluster... Running tests in /ClickHouse/tests/integration/test_s3_zero_copy_replication/test.py Running tests in /ClickHouse/tests/integration/test_s3_zero_copy_replication/test.py Cluster start called. is_up=False Cluster start called. is_up=False Docker networks for project roottests3zerocopyreplication_gw0 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3zerocopyreplication_gw0 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottests3zerocopyreplication_gw0 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3zerocopyreplication_gw0 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottests3zerocopyreplication_gw0 are DRIVER VOLUME NAME Docker volumes for project roottests3zerocopyreplication_gw0 are DRIVER VOLUME NAME Cleanup called Cleanup called Docker networks for project roottests3zerocopyreplication_gw0 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3zerocopyreplication_gw0 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottests3zerocopyreplication_gw0 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3zerocopyreplication_gw0 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottests3zerocopyreplication_gw0 are DRIVER VOLUME NAME Docker volumes for project roottests3zerocopyreplication_gw0 are DRIVER VOLUME NAME Command:docker container list --all --filter name='^/roottests3zerocopyreplication_gw0_.*_1$' --format '{{.ID}}:{{.Names}}' Command:docker container list --all --filter name='^/roottests3zerocopyreplication_gw0_.*_1$' --format '{{.ID}}:{{.Names}}' Unstopped containers: {} Unstopped containers: {} No running containers for project: roottests3zerocopyreplication_gw0 No running containers for project: roottests3zerocopyreplication_gw0 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused volumes... Trying to prune unused volumes... Command:['docker volume ls | wc -l'] Command:['docker volume ls | wc -l'] Stdout:1 Stdout:1 Setup directory for instance: node1 Setup directory for instance: node1 Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_s3_zero_copy_replication/configs/config.d/s3.xml'] to /ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_s3_zero_copy_replication/configs/config.d/s3.xml'] to /ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/configs/config.d Setup database dir /ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/database Setup database dir /ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/database Setup logs dir /ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/logs Setup logs dir /ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log"] Setup directory for instance: node2 Setup directory for instance: node2 Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_s3_zero_copy_replication/configs/config.d/s3.xml'] to /ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_s3_zero_copy_replication/configs/config.d/s3.xml'] to /ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/configs/config.d Setup database dir /ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/database Setup database dir /ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/database Setup logs dir /ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/logs Setup logs dir /ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log"] Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:b74d853ebe76', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/keeper3/coordination', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/minio/certs/public.crt'} stored in /ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:b74d853ebe76', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/keeper3/coordination', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/minio/certs/public.crt'} stored in /ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found http://localhost:None "GET /version HTTP/1.1" 200 825 http://localhost:None "GET /version HTTP/1.1" 200 825 Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] Stderr:Pulling zoo1 ... Stderr:Pulling zoo1 ... Stderr:Pulling proxy1 ... Stderr:Pulling proxy1 ... Stderr:Pulling zoo3 ... Stderr:Pulling zoo3 ... Stderr:Pulling proxy2 ... Stderr:Pulling proxy2 ... Stderr:Pulling minio1 ... Stderr:Pulling minio1 ... Stderr:Pulling resolver ... Stderr:Pulling resolver ... Stderr:Pulling zoo2 ... Stderr:Pulling zoo2 ... Stderr:Pulling node1 ... Stderr:Pulling node1 ... Stderr:Pulling node2 ... Stderr:Pulling node2 ... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo1 ... status: image is up to date for a... Stderr:Pulling zoo1 ... status: image is up to date for a... Stderr:Pulling resolver ... done Stderr:Pulling resolver ... done Stderr:Pulling zoo1 ... done Stderr:Pulling zoo1 ... done Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy1 ... done Stderr:Pulling proxy1 ... done Stderr:Pulling proxy2 ... done Stderr:Pulling proxy2 ... done Stderr:Pulling minio1 ... error Stderr:Pulling minio1 ... error Stderr:Pulling node1 ... pulling from altinityinfra/integr... Stderr:Pulling node1 ... pulling from altinityinfra/integr... Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... Stderr:Pulling node2 ... pulling from altinityinfra/integr... Stderr:Pulling node2 ... pulling from altinityinfra/integr... Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node1 ... status: image is up to date for a... Stderr:Pulling node1 ... status: image is up to date for a... Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo3 ... status: image is up to date for a... Stderr:Pulling zoo3 ... status: image is up to date for a... Stderr:Pulling node1 ... done Stderr:Pulling node1 ... done Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo2 ... status: image is up to date for a... Stderr:Pulling zoo2 ... status: image is up to date for a... Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node2 ... status: image is up to date for a... Stderr:Pulling node2 ... status: image is up to date for a... Stderr:Pulling zoo3 ... done Stderr:Pulling zoo3 ... done Stderr:Pulling zoo2 ... done Stderr:Pulling zoo2 ... done Stderr:Pulling node2 ... done Stderr:Pulling node2 ... done Stderr: Stderr: Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Exitcode:1 Exitcode:1 Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo1 ... Pulling proxy1 ... Pulling zoo3 ... Pulling proxy2 ... Pulling minio1 ... Pulling resolver ... Pulling zoo2 ... Pulling node1 ... Pulling node2 ... Pulling resolver ... pulling from altinityinfra/python... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling resolver ... done Pulling zoo1 ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy1 ... done Pulling proxy2 ... done Pulling minio1 ... error Pulling node1 ... pulling from altinityinfra/integr... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling zoo2 ... pulling from altinityinfra/integr... Pulling node2 ... pulling from altinityinfra/integr... Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling node1 ... done Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling zoo3 ... done Pulling zoo2 ... done Pulling node2 ... done ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo1 ... Pulling proxy1 ... Pulling zoo3 ... Pulling proxy2 ... Pulling minio1 ... Pulling resolver ... Pulling zoo2 ... Pulling node1 ... Pulling node2 ... Pulling resolver ... pulling from altinityinfra/python... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling resolver ... done Pulling zoo1 ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy1 ... done Pulling proxy2 ... done Pulling minio1 ... error Pulling node1 ... pulling from altinityinfra/integr... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling zoo2 ... pulling from altinityinfra/integr... Pulling node2 ... pulling from altinityinfra/integr... Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling node1 ... done Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling zoo3 ... done Pulling zoo2 ... done Pulling node2 ... done ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] Stderr:Pulling zoo3 ... Stderr:Pulling zoo3 ... Stderr:Pulling proxy1 ... Stderr:Pulling proxy1 ... Stderr:Pulling zoo1 ... Stderr:Pulling zoo1 ... Stderr:Pulling zoo2 ... Stderr:Pulling zoo2 ... Stderr:Pulling proxy2 ... Stderr:Pulling proxy2 ... Stderr:Pulling resolver ... Stderr:Pulling resolver ... Stderr:Pulling minio1 ... Stderr:Pulling minio1 ... Stderr:Pulling node2 ... Stderr:Pulling node2 ... Stderr:Pulling node1 ... Stderr:Pulling node1 ... Stderr:Pulling node1 ... pulling from altinityinfra/integr... Stderr:Pulling node1 ... pulling from altinityinfra/integr... Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node1 ... status: image is up to date for a... Stderr:Pulling node1 ... status: image is up to date for a... Stderr:Pulling node1 ... done Stderr:Pulling node1 ... done Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo1 ... status: image is up to date for a... Stderr:Pulling zoo1 ... status: image is up to date for a... Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling zoo1 ... done Stderr:Pulling zoo1 ... done Stderr:Pulling proxy2 ... done Stderr:Pulling proxy2 ... done Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo2 ... status: image is up to date for a... Stderr:Pulling zoo2 ... status: image is up to date for a... Stderr:Pulling zoo2 ... done Stderr:Pulling zoo2 ... done Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo3 ... status: image is up to date for a... Stderr:Pulling zoo3 ... status: image is up to date for a... Stderr:Pulling zoo3 ... done Stderr:Pulling zoo3 ... done Stderr:Pulling node2 ... pulling from altinityinfra/integr... Stderr:Pulling node2 ... pulling from altinityinfra/integr... Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node2 ... status: image is up to date for a... Stderr:Pulling node2 ... status: image is up to date for a... Stderr:Pulling node2 ... done Stderr:Pulling node2 ... done Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... done Stderr:Pulling proxy1 ... done Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling resolver ... done Stderr:Pulling resolver ... done Stderr:Pulling minio1 ... error Stderr:Pulling minio1 ... error Stderr: Stderr: Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Exitcode:1 Exitcode:1 Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo3 ... Pulling proxy1 ... Pulling zoo1 ... Pulling zoo2 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling node2 ... Pulling node1 ... Pulling node1 ... pulling from altinityinfra/integr... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling zoo2 ... pulling from altinityinfra/integr... Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling zoo1 ... done Pulling proxy2 ... done Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling node2 ... pulling from altinityinfra/integr... Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling node2 ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo3 ... Pulling proxy1 ... Pulling zoo1 ... Pulling zoo2 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling node2 ... Pulling node1 ... Pulling node1 ... pulling from altinityinfra/integr... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling zoo2 ... pulling from altinityinfra/integr... Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling zoo1 ... done Pulling proxy2 ... done Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling node2 ... pulling from altinityinfra/integr... Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling node2 ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] Stderr:Pulling zoo3 ... Stderr:Pulling zoo3 ... Stderr:Pulling zoo2 ... Stderr:Pulling zoo2 ... Stderr:Pulling zoo1 ... Stderr:Pulling zoo1 ... Stderr:Pulling proxy2 ... Stderr:Pulling proxy2 ... Stderr:Pulling proxy1 ... Stderr:Pulling proxy1 ... Stderr:Pulling resolver ... Stderr:Pulling resolver ... Stderr:Pulling minio1 ... Stderr:Pulling minio1 ... Stderr:Pulling node2 ... Stderr:Pulling node2 ... Stderr:Pulling node1 ... Stderr:Pulling node1 ... Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... done Stderr:Pulling proxy2 ... done Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... Stderr:Pulling node2 ... pulling from altinityinfra/integr... Stderr:Pulling node2 ... pulling from altinityinfra/integr... Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo3 ... status: image is up to date for a... Stderr:Pulling zoo3 ... status: image is up to date for a... Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo2 ... status: image is up to date for a... Stderr:Pulling zoo2 ... status: image is up to date for a... Stderr:Pulling zoo3 ... done Stderr:Pulling zoo3 ... done Stderr:Pulling zoo2 ... done Stderr:Pulling zoo2 ... done Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node2 ... status: image is up to date for a... Stderr:Pulling node2 ... status: image is up to date for a... Stderr:Pulling node2 ... done Stderr:Pulling node2 ... done Stderr:Pulling minio1 ... error Stderr:Pulling minio1 ... error Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling node1 ... pulling from altinityinfra/integr... Stderr:Pulling node1 ... pulling from altinityinfra/integr... Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling proxy1 ... done Stderr:Pulling proxy1 ... done Stderr:Pulling resolver ... done Stderr:Pulling resolver ... done Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node1 ... status: image is up to date for a... Stderr:Pulling node1 ... status: image is up to date for a... Stderr:Pulling node1 ... done Stderr:Pulling node1 ... done Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo1 ... status: image is up to date for a... Stderr:Pulling zoo1 ... status: image is up to date for a... Stderr:Pulling zoo1 ... done Stderr:Pulling zoo1 ... done Stderr: Stderr: Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Exitcode:1 Exitcode:1 Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo3 ... Pulling zoo2 ... Pulling zoo1 ... Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node2 ... Pulling node1 ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling zoo3 ... pulling from altinityinfra/integr... Pulling zoo2 ... pulling from altinityinfra/integr... Pulling node2 ... pulling from altinityinfra/integr... Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo3 ... done Pulling zoo2 ... done Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling node2 ... done Pulling minio1 ... error Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling node1 ... pulling from altinityinfra/integr... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling proxy1 ... done Pulling resolver ... done Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo3 ... Pulling zoo2 ... Pulling zoo1 ... Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node2 ... Pulling node1 ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling zoo3 ... pulling from altinityinfra/integr... Pulling zoo2 ... pulling from altinityinfra/integr... Pulling node2 ... pulling from altinityinfra/integr... Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo3 ... done Pulling zoo2 ... done Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling node2 ... done Pulling minio1 ... error Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling node1 ... pulling from altinityinfra/integr... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling proxy1 ... done Pulling resolver ... done Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] Stderr:Pulling zoo1 ... Stderr:Pulling zoo1 ... Stderr:Pulling zoo3 ... Stderr:Pulling zoo3 ... Stderr:Pulling zoo2 ... Stderr:Pulling zoo2 ... Stderr:Pulling proxy1 ... Stderr:Pulling proxy1 ... Stderr:Pulling proxy2 ... Stderr:Pulling proxy2 ... Stderr:Pulling resolver ... Stderr:Pulling resolver ... Stderr:Pulling minio1 ... Stderr:Pulling minio1 ... Stderr:Pulling node1 ... Stderr:Pulling node1 ... Stderr:Pulling node2 ... Stderr:Pulling node2 ... Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy1 ... done Stderr:Pulling proxy1 ... done Stderr:Pulling proxy2 ... done Stderr:Pulling proxy2 ... done Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo2 ... status: image is up to date for a... Stderr:Pulling zoo2 ... status: image is up to date for a... Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo3 ... status: image is up to date for a... Stderr:Pulling zoo3 ... status: image is up to date for a... Stderr:Pulling zoo2 ... done Stderr:Pulling zoo2 ... done Stderr:Pulling zoo3 ... done Stderr:Pulling zoo3 ... done Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo1 ... status: image is up to date for a... Stderr:Pulling zoo1 ... status: image is up to date for a... Stderr:Pulling zoo1 ... done Stderr:Pulling zoo1 ... done Stderr:Pulling node1 ... pulling from altinityinfra/integr... Stderr:Pulling node1 ... pulling from altinityinfra/integr... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node1 ... status: image is up to date for a... Stderr:Pulling node1 ... status: image is up to date for a... Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling node1 ... done Stderr:Pulling node1 ... done Stderr:Pulling resolver ... done Stderr:Pulling resolver ... done Stderr:Pulling node2 ... pulling from altinityinfra/integr... Stderr:Pulling node2 ... pulling from altinityinfra/integr... Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node2 ... status: image is up to date for a... Stderr:Pulling node2 ... status: image is up to date for a... Stderr:Pulling node2 ... done Stderr:Pulling node2 ... done Stderr:Pulling minio1 ... error Stderr:Pulling minio1 ... error Stderr: Stderr: Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Exitcode:1 Exitcode:1 Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo1 ... Pulling zoo3 ... Pulling zoo2 ... Pulling proxy1 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling node1 ... Pulling node2 ... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling zoo2 ... pulling from altinityinfra/integr... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy1 ... done Pulling proxy2 ... done Pulling zoo1 ... pulling from altinityinfra/integr... Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo2 ... done Pulling zoo3 ... done Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling node1 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling node1 ... done Pulling resolver ... done Pulling node2 ... pulling from altinityinfra/integr... Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling node2 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo1 ... Pulling zoo3 ... Pulling zoo2 ... Pulling proxy1 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling node1 ... Pulling node2 ... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling zoo2 ... pulling from altinityinfra/integr... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy1 ... done Pulling proxy2 ... done Pulling zoo1 ... pulling from altinityinfra/integr... Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo2 ... done Pulling zoo3 ... done Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling node1 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling node1 ... done Pulling resolver ... done Pulling node2 ... pulling from altinityinfra/integr... Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling node2 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] Stderr:Pulling proxy1 ... Stderr:Pulling proxy1 ... Stderr:Pulling zoo3 ... Stderr:Pulling zoo3 ... Stderr:Pulling zoo2 ... Stderr:Pulling zoo2 ... Stderr:Pulling zoo1 ... Stderr:Pulling zoo1 ... Stderr:Pulling proxy2 ... Stderr:Pulling proxy2 ... Stderr:Pulling minio1 ... Stderr:Pulling minio1 ... Stderr:Pulling node1 ... Stderr:Pulling node1 ... Stderr:Pulling node2 ... Stderr:Pulling node2 ... Stderr:Pulling resolver ... Stderr:Pulling resolver ... Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... Stderr:Pulling node1 ... pulling from altinityinfra/integr... Stderr:Pulling node1 ... pulling from altinityinfra/integr... Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... done Stderr:Pulling proxy2 ... done Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo3 ... status: image is up to date for a... Stderr:Pulling zoo3 ... status: image is up to date for a... Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node1 ... status: image is up to date for a... Stderr:Pulling node1 ... status: image is up to date for a... Stderr:Pulling zoo3 ... done Stderr:Pulling zoo3 ... done Stderr:Pulling node1 ... done Stderr:Pulling node1 ... done Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo1 ... status: image is up to date for a... Stderr:Pulling zoo1 ... status: image is up to date for a... Stderr:Pulling zoo1 ... done Stderr:Pulling zoo1 ... done Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... done Stderr:Pulling proxy1 ... done Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo2 ... status: image is up to date for a... Stderr:Pulling zoo2 ... status: image is up to date for a... Stderr:Pulling zoo2 ... done Stderr:Pulling zoo2 ... done Stderr:Pulling node2 ... pulling from altinityinfra/integr... Stderr:Pulling node2 ... pulling from altinityinfra/integr... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node2 ... status: image is up to date for a... Stderr:Pulling node2 ... status: image is up to date for a... Stderr:Pulling node2 ... done Stderr:Pulling node2 ... done Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling resolver ... done Stderr:Pulling resolver ... done Stderr:Pulling minio1 ... error Stderr:Pulling minio1 ... error Stderr: Stderr: Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Exitcode:1 Exitcode:1 Failed to start cluster: Failed to start cluster: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling zoo3 ... Pulling zoo2 ... Pulling zoo1 ... Pulling proxy2 ... Pulling minio1 ... Pulling node1 ... Pulling node2 ... Pulling resolver ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling zoo3 ... pulling from altinityinfra/integr... Pulling node1 ... pulling from altinityinfra/integr... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling zoo3 ... done Pulling node1 ... done Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling zoo2 ... pulling from altinityinfra/integr... Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling node2 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling node2 ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling zoo3 ... Pulling zoo2 ... Pulling zoo1 ... Pulling proxy2 ... Pulling minio1 ... Pulling node1 ... Pulling node2 ... Pulling resolver ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling zoo3 ... pulling from altinityinfra/integr... Pulling node1 ... pulling from altinityinfra/integr... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling zoo3 ... done Pulling node1 ... done Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling zoo2 ... pulling from altinityinfra/integr... Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling node2 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling node2 ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Traceback (most recent call last): File "/ClickHouse/tests/integration/helpers/cluster.py", line 2831, in start retry(log_function=logging_pulling_images)(run_and_check)( File "/ClickHouse/tests/integration/helpers/retry_decorator.py", line 28, in wrapper raise e File "/ClickHouse/tests/integration/helpers/retry_decorator.py", line 19, in wrapper func(*args, **kwargs) File "/ClickHouse/tests/integration/helpers/cluster.py", line 129, in run_and_check raise Exception( Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling zoo3 ... Pulling zoo2 ... Pulling zoo1 ... Pulling proxy2 ... Pulling minio1 ... Pulling node1 ... Pulling node2 ... Pulling resolver ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling zoo3 ... pulling from altinityinfra/integr... Pulling node1 ... pulling from altinityinfra/integr... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling zoo3 ... done Pulling node1 ... done Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling zoo2 ... pulling from altinityinfra/integr... Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling node2 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling node2 ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied None None docker-compose up was not called. Trying to export docker.log for running containers docker-compose up was not called. Trying to export docker.log for running containers Cleanup called Cleanup called Docker networks for project roottests3zerocopyreplication_gw0 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3zerocopyreplication_gw0 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottests3zerocopyreplication_gw0 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3zerocopyreplication_gw0 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottests3zerocopyreplication_gw0 are DRIVER VOLUME NAME Docker volumes for project roottests3zerocopyreplication_gw0 are DRIVER VOLUME NAME Command:docker container list --all --filter name='^/roottests3zerocopyreplication_gw0_.*_1$' --format '{{.ID}}:{{.Names}}' Command:docker container list --all --filter name='^/roottests3zerocopyreplication_gw0_.*_1$' --format '{{.ID}}:{{.Names}}' Unstopped containers: {} Unstopped containers: {} No running containers for project: roottests3zerocopyreplication_gw0 No running containers for project: roottests3zerocopyreplication_gw0 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused volumes... Trying to prune unused volumes... Command:['docker volume ls | wc -l'] Command:['docker volume ls | wc -l'] Stdout:1 Stdout:1 docker-compose up was not called. Trying to export docker.log for running containers docker-compose up was not called. Trying to export docker.log for running containers Cleanup called Cleanup called Docker networks for project roottests3zerocopyreplication_gw0 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3zerocopyreplication_gw0 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottests3zerocopyreplication_gw0 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3zerocopyreplication_gw0 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottests3zerocopyreplication_gw0 are DRIVER VOLUME NAME Docker volumes for project roottests3zerocopyreplication_gw0 are DRIVER VOLUME NAME Command:docker container list --all --filter name='^/roottests3zerocopyreplication_gw0_.*_1$' --format '{{.ID}}:{{.Names}}' Command:docker container list --all --filter name='^/roottests3zerocopyreplication_gw0_.*_1$' --format '{{.ID}}:{{.Names}}' Unstopped containers: {} Unstopped containers: {} No running containers for project: roottests3zerocopyreplication_gw0 No running containers for project: roottests3zerocopyreplication_gw0 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused volumes... Trying to prune unused volumes... Command:['docker volume ls | wc -l'] Command:['docker volume ls | wc -l'] Stdout:1 Stdout:1 ------------------------------ Captured log setup ------------------------------ 2026-09-30 17:43:14 [ 463 ] DEBUG : Command:['docker ps | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 17:43:14 [ 463 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-09-30 17:43:14 [ 463 ] DEBUG : No running containers (conftest.py:95, cleanup_environment) 2026-09-30 17:43:14 [ 463 ] DEBUG : Pruning Docker networks (conftest.py:97, cleanup_environment) 2026-09-30 17:43:14 [ 463 ] DEBUG : Command:['docker network prune --force'] (cluster.py:113, run_and_check) 2026-09-30 17:43:14 [ 463 ] DEBUG : Command:["sysctl net.ipv4.ip_local_port_range='55000 65535'"] (cluster.py:113, run_and_check) 2026-09-30 17:43:14 [ 463 ] DEBUG : Stdout:net.ipv4.ip_local_port_range = 55000 65535 (cluster.py:121, run_and_check) 2026-09-30 17:43:14 [ 463 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1787, add_instance) 2026-09-30 17:43:14 [ 463 ] DEBUG : Setup Keeper (cluster.py:1059, setup_keeper_cmd) 2026-09-30 17:43:14 [ 463 ] DEBUG : Cluster name: project_name:roottests3zerocopyreplication_gw0. Added instance name:node1 tag:b74d853ebe76 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ (cluster.py:2081, add_instance) 2026-09-30 17:43:14 [ 463 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1787, add_instance) 2026-09-30 17:43:14 [ 463 ] DEBUG : Cluster name: project_name:roottests3zerocopyreplication_gw0. Added instance name:node2 tag:b74d853ebe76 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ (cluster.py:2081, add_instance) 2026-09-30 17:43:14 [ 463 ] INFO : Starting cluster... (test.py:33, started_cluster) 2026-09-30 17:43:14 [ 463 ] INFO : Running tests in /ClickHouse/tests/integration/test_s3_zero_copy_replication/test.py (cluster.py:2790, start) 2026-09-30 17:43:14 [ 463 ] DEBUG : Cluster start called. is_up=False (cluster.py:2797, start) 2026-09-30 17:43:14 [ 463 ] DEBUG : Docker networks for project roottests3zerocopyreplication_gw0 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 17:43:14 [ 463 ] DEBUG : Docker containers for project roottests3zerocopyreplication_gw0 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 17:43:14 [ 463 ] DEBUG : Docker volumes for project roottests3zerocopyreplication_gw0 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 17:43:14 [ 463 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 17:43:14 [ 463 ] DEBUG : Docker networks for project roottests3zerocopyreplication_gw0 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 17:43:14 [ 463 ] DEBUG : Docker containers for project roottests3zerocopyreplication_gw0 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 17:43:14 [ 463 ] DEBUG : Docker volumes for project roottests3zerocopyreplication_gw0 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 17:43:14 [ 463 ] DEBUG : Command:docker container list --all --filter name='^/roottests3zerocopyreplication_gw0_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 17:43:14 [ 463 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 17:43:14 [ 463 ] DEBUG : No running containers for project: roottests3zerocopyreplication_gw0 (cluster.py:904, cleanup) 2026-09-30 17:43:14 [ 463 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 17:43:14 [ 463 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 17:43:14 [ 463 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 17:43:14 [ 463 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-09-30 17:43:14 [ 463 ] DEBUG : Setup directory for instance: node1 (cluster.py:2810, start) 2026-09-30 17:43:14 [ 463 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4538, create_dir) 2026-09-30 17:43:14 [ 463 ] DEBUG : Create directory for common tests configuration (cluster.py:4543, create_dir) 2026-09-30 17:43:14 [ 463 ] DEBUG : Copy common configuration from helpers (cluster.py:4563, create_dir) 2026-09-30 17:43:14 [ 463 ] DEBUG : Generate and write macros file (cluster.py:4606, create_dir) 2026-09-30 17:43:14 [ 463 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_s3_zero_copy_replication/configs/config.d/s3.xml'] to /ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/configs/config.d (cluster.py:4636, create_dir) 2026-09-30 17:43:14 [ 463 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/database (cluster.py:4653, create_dir) 2026-09-30 17:43:14 [ 463 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/logs (cluster.py:4664, create_dir) 2026-09-30 17:43:14 [ 463 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log"] (cluster.py:4750, create_dir) 2026-09-30 17:43:14 [ 463 ] DEBUG : Setup directory for instance: node2 (cluster.py:2810, start) 2026-09-30 17:43:14 [ 463 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4538, create_dir) 2026-09-30 17:43:14 [ 463 ] DEBUG : Create directory for common tests configuration (cluster.py:4543, create_dir) 2026-09-30 17:43:14 [ 463 ] DEBUG : Copy common configuration from helpers (cluster.py:4563, create_dir) 2026-09-30 17:43:14 [ 463 ] DEBUG : Generate and write macros file (cluster.py:4606, create_dir) 2026-09-30 17:43:14 [ 463 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_s3_zero_copy_replication/configs/config.d/s3.xml'] to /ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/configs/config.d (cluster.py:4636, create_dir) 2026-09-30 17:43:14 [ 463 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/database (cluster.py:4653, create_dir) 2026-09-30 17:43:14 [ 463 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/logs (cluster.py:4664, create_dir) 2026-09-30 17:43:14 [ 463 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log"] (cluster.py:4750, create_dir) 2026-09-30 17:43:14 [ 463 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:b74d853ebe76', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/keeper3/coordination', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/minio/certs/public.crt'} stored in /ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env (cluster.py:86, _create_env_file) 2026-09-30 17:43:14 [ 463 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-09-30 17:43:14 [ 463 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-09-30 17:43:14 [ 463 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-09-30 17:43:14 [ 463 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-09-30 17:43:14 [ 463 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 825 (connectionpool.py:547, _make_request) 2026-09-30 17:43:14 [ 463 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 17:44:50 [ 463 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-09-30 17:44:50 [ 463 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 17:44:50 [ 463 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-09-30 17:44:50 [ 463 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 17:44:50 [ 463 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 17:44:50 [ 463 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 17:44:50 [ 463 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-09-30 17:44:50 [ 463 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-09-30 17:44:50 [ 463 ] DEBUG : Stderr:Pulling node2 ... (cluster.py:123, run_and_check) 2026-09-30 17:44:50 [ 463 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 17:44:50 [ 463 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 17:44:50 [ 463 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 17:44:50 [ 463 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 17:44:50 [ 463 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 17:44:50 [ 463 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:44:50 [ 463 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 17:44:50 [ 463 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:44:50 [ 463 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 17:44:50 [ 463 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-09-30 17:44:50 [ 463 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 17:44:50 [ 463 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:44:50 [ 463 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 17:44:50 [ 463 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:44:50 [ 463 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 17:44:50 [ 463 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 17:44:50 [ 463 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 17:44:50 [ 463 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 17:44:50 [ 463 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 17:44:50 [ 463 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 17:44:50 [ 463 ] DEBUG : Stderr:Pulling node2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 17:44:50 [ 463 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 17:44:50 [ 463 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:44:50 [ 463 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 17:44:50 [ 463 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:44:50 [ 463 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-09-30 17:44:50 [ 463 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 17:44:50 [ 463 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:44:50 [ 463 ] DEBUG : Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 17:44:50 [ 463 ] DEBUG : Stderr:Pulling node2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:44:50 [ 463 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-09-30 17:44:50 [ 463 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-09-30 17:44:50 [ 463 ] DEBUG : Stderr:Pulling node2 ... done (cluster.py:123, run_and_check) 2026-09-30 17:44:50 [ 463 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 17:44:50 [ 463 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 17:44:50 [ 463 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 17:44:50 [ 463 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 17:44:50 [ 463 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo1 ... Pulling proxy1 ... Pulling zoo3 ... Pulling proxy2 ... Pulling minio1 ... Pulling resolver ... Pulling zoo2 ... Pulling node1 ... Pulling node2 ... Pulling resolver ... pulling from altinityinfra/python... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling resolver ... done Pulling zoo1 ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy1 ... done Pulling proxy2 ... done Pulling minio1 ... error Pulling node1 ... pulling from altinityinfra/integr... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling zoo2 ... pulling from altinityinfra/integr... Pulling node2 ... pulling from altinityinfra/integr... Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling node1 ... done Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling zoo3 ... done Pulling zoo2 ... done Pulling node2 ... done ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 17:44:53 [ 463 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 17:46:36 [ 463 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 463 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 463 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 463 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 463 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 463 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 463 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 463 ] DEBUG : Stderr:Pulling node2 ... (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 463 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 463 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 463 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 463 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 463 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 463 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 463 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 463 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 463 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 463 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 463 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 463 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 463 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 463 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 463 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 463 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 463 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 463 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 463 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 463 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 463 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 463 ] DEBUG : Stderr:Pulling node2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 463 ] DEBUG : Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 463 ] DEBUG : Stderr:Pulling node2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 463 ] DEBUG : Stderr:Pulling node2 ... done (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 463 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 463 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 463 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 463 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 463 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 463 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 463 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 463 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 463 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 463 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 463 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 463 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 463 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 17:46:36 [ 463 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo3 ... Pulling proxy1 ... Pulling zoo1 ... Pulling zoo2 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling node2 ... Pulling node1 ... Pulling node1 ... pulling from altinityinfra/integr... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling zoo2 ... pulling from altinityinfra/integr... Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling zoo1 ... done Pulling proxy2 ... done Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling node2 ... pulling from altinityinfra/integr... Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling node2 ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 17:46:39 [ 463 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 17:48:23 [ 463 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 463 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 463 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 463 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 463 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 463 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 463 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 463 ] DEBUG : Stderr:Pulling node2 ... (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 463 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 463 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 463 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 463 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 463 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 463 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 463 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 463 ] DEBUG : Stderr:Pulling node2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 463 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 463 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 463 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 463 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 463 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 463 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 463 ] DEBUG : Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 463 ] DEBUG : Stderr:Pulling node2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 463 ] DEBUG : Stderr:Pulling node2 ... done (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 463 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 463 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 463 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 463 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 463 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 463 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 463 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 463 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 463 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 463 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 463 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 463 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 463 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 463 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 463 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 463 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 463 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 463 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 463 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 463 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 463 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 17:48:23 [ 463 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo3 ... Pulling zoo2 ... Pulling zoo1 ... Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node2 ... Pulling node1 ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling zoo3 ... pulling from altinityinfra/integr... Pulling zoo2 ... pulling from altinityinfra/integr... Pulling node2 ... pulling from altinityinfra/integr... Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo3 ... done Pulling zoo2 ... done Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling node2 ... done Pulling minio1 ... error Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling node1 ... pulling from altinityinfra/integr... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling proxy1 ... done Pulling resolver ... done Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 17:48:25 [ 463 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 17:49:51 [ 463 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-09-30 17:49:51 [ 463 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-09-30 17:49:51 [ 463 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-09-30 17:49:51 [ 463 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 17:49:51 [ 463 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 17:49:51 [ 463 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 17:49:51 [ 463 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 17:49:51 [ 463 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-09-30 17:49:51 [ 463 ] DEBUG : Stderr:Pulling node2 ... (cluster.py:123, run_and_check) 2026-09-30 17:49:51 [ 463 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 17:49:51 [ 463 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 17:49:51 [ 463 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 17:49:51 [ 463 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 17:49:51 [ 463 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 17:49:51 [ 463 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:49:51 [ 463 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 17:49:51 [ 463 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:49:51 [ 463 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 17:49:51 [ 463 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 17:49:51 [ 463 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 17:49:51 [ 463 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 17:49:51 [ 463 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:49:51 [ 463 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 17:49:51 [ 463 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:49:51 [ 463 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-09-30 17:49:51 [ 463 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-09-30 17:49:51 [ 463 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 17:49:51 [ 463 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:49:51 [ 463 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-09-30 17:49:51 [ 463 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 17:49:51 [ 463 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 17:49:51 [ 463 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 17:49:51 [ 463 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:49:51 [ 463 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 17:49:51 [ 463 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:49:51 [ 463 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-09-30 17:49:51 [ 463 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 17:49:51 [ 463 ] DEBUG : Stderr:Pulling node2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 17:49:51 [ 463 ] DEBUG : Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 17:49:51 [ 463 ] DEBUG : Stderr:Pulling node2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:49:51 [ 463 ] DEBUG : Stderr:Pulling node2 ... done (cluster.py:123, run_and_check) 2026-09-30 17:49:51 [ 463 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 17:49:51 [ 463 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 17:49:51 [ 463 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 17:49:51 [ 463 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 17:49:51 [ 463 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 17:49:51 [ 463 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo1 ... Pulling zoo3 ... Pulling zoo2 ... Pulling proxy1 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling node1 ... Pulling node2 ... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling zoo2 ... pulling from altinityinfra/integr... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy1 ... done Pulling proxy2 ... done Pulling zoo1 ... pulling from altinityinfra/integr... Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo2 ... done Pulling zoo3 ... done Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling node1 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling node1 ... done Pulling resolver ... done Pulling node2 ... pulling from altinityinfra/integr... Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling node2 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 17:49:56 [ 463 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 17:51:41 [ 463 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 17:51:41 [ 463 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-09-30 17:51:41 [ 463 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-09-30 17:51:41 [ 463 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-09-30 17:51:41 [ 463 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 17:51:41 [ 463 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 17:51:41 [ 463 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-09-30 17:51:41 [ 463 ] DEBUG : Stderr:Pulling node2 ... (cluster.py:123, run_and_check) 2026-09-30 17:51:41 [ 463 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 17:51:41 [ 463 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 17:51:41 [ 463 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 17:51:41 [ 463 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 17:51:41 [ 463 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 17:51:41 [ 463 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 17:51:41 [ 463 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:51:41 [ 463 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 17:51:41 [ 463 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 17:51:41 [ 463 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:51:41 [ 463 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 17:51:41 [ 463 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:51:41 [ 463 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-09-30 17:51:41 [ 463 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-09-30 17:51:41 [ 463 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 17:51:41 [ 463 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:51:41 [ 463 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-09-30 17:51:41 [ 463 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 17:51:41 [ 463 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 17:51:41 [ 463 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:51:41 [ 463 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 17:51:41 [ 463 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 17:51:41 [ 463 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 17:51:41 [ 463 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:51:41 [ 463 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-09-30 17:51:41 [ 463 ] DEBUG : Stderr:Pulling node2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 17:51:41 [ 463 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 17:51:41 [ 463 ] DEBUG : Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 17:51:41 [ 463 ] DEBUG : Stderr:Pulling node2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:51:41 [ 463 ] DEBUG : Stderr:Pulling node2 ... done (cluster.py:123, run_and_check) 2026-09-30 17:51:41 [ 463 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 17:51:41 [ 463 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:51:41 [ 463 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 17:51:41 [ 463 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 17:51:41 [ 463 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 17:51:41 [ 463 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 17:51:41 [ 463 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 17:51:41 [ 463 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 17:51:41 [ 463 ] DEBUG : Failed to start cluster: (cluster.py:3178, start) 2026-09-30 17:51:41 [ 463 ] DEBUG : Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling zoo3 ... Pulling zoo2 ... Pulling zoo1 ... Pulling proxy2 ... Pulling minio1 ... Pulling node1 ... Pulling node2 ... Pulling resolver ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling zoo3 ... pulling from altinityinfra/integr... Pulling node1 ... pulling from altinityinfra/integr... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling zoo3 ... done Pulling node1 ... done Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling zoo2 ... pulling from altinityinfra/integr... Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling node2 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling node2 ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:3179, start) 2026-09-30 17:51:41 [ 463 ] DEBUG : None (cluster.py:3180, start) 2026-09-30 17:51:41 [ 463 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3246, shutdown) 2026-09-30 17:51:41 [ 463 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 17:51:41 [ 463 ] DEBUG : Docker networks for project roottests3zerocopyreplication_gw0 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 17:51:41 [ 463 ] DEBUG : Docker containers for project roottests3zerocopyreplication_gw0 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 17:51:41 [ 463 ] DEBUG : Docker volumes for project roottests3zerocopyreplication_gw0 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 17:51:41 [ 463 ] DEBUG : Command:docker container list --all --filter name='^/roottests3zerocopyreplication_gw0_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 17:51:41 [ 463 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 17:51:41 [ 463 ] DEBUG : No running containers for project: roottests3zerocopyreplication_gw0 (cluster.py:904, cleanup) 2026-09-30 17:51:41 [ 463 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 17:51:41 [ 463 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 17:51:41 [ 463 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 17:51:41 [ 463 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-09-30 17:51:41 [ 463 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3246, shutdown) 2026-09-30 17:51:41 [ 463 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 17:51:41 [ 463 ] DEBUG : Docker networks for project roottests3zerocopyreplication_gw0 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 17:51:41 [ 463 ] DEBUG : Docker containers for project roottests3zerocopyreplication_gw0 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 17:51:41 [ 463 ] DEBUG : Docker volumes for project roottests3zerocopyreplication_gw0 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 17:51:41 [ 463 ] DEBUG : Command:docker container list --all --filter name='^/roottests3zerocopyreplication_gw0_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 17:51:41 [ 463 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 17:51:41 [ 463 ] DEBUG : No running containers for project: roottests3zerocopyreplication_gw0 (cluster.py:904, cleanup) 2026-09-30 17:51:41 [ 463 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 17:51:41 [ 463 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 17:51:41 [ 463 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 17:51:41 [ 463 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) _ ERROR at setup of test_move_shared_zero_copy_lock_fail[None-zero_copy_lock_zk_fail_after_op] _ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster.add_instance( "node1", main_configs=["configs/config.d/s3.xml"], macros={"replica": "1"}, with_minio=True, with_zookeeper=True, ) cluster.add_instance( "node2", main_configs=["configs/config.d/s3.xml"], macros={"replica": "2"}, with_minio=True, with_zookeeper=True, ) logging.info("Starting cluster...") > cluster.start() test_s3_zero_copy_replication/test.py:34: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling zoo3 ... E Pulling zoo2 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling minio1 ... E Pulling node1 ... E Pulling node2 ... E Pulling resolver ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling node1 ... digest: sha256:2ea9da862c215fd684... E Pulling node1 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling node1 ... done E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling node2 ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling node2 ... digest: sha256:2ea9da862c215fd684... E Pulling node2 ... status: image is up to date for a... E Pulling node2 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _ ERROR at setup of test_move_shared_zero_copy_lock_fail[None-zero_copy_lock_zk_fail_before_op] _ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster.add_instance( "node1", main_configs=["configs/config.d/s3.xml"], macros={"replica": "1"}, with_minio=True, with_zookeeper=True, ) cluster.add_instance( "node2", main_configs=["configs/config.d/s3.xml"], macros={"replica": "2"}, with_minio=True, with_zookeeper=True, ) logging.info("Starting cluster...") > cluster.start() test_s3_zero_copy_replication/test.py:34: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling zoo3 ... E Pulling zoo2 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling minio1 ... E Pulling node1 ... E Pulling node2 ... E Pulling resolver ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling node1 ... digest: sha256:2ea9da862c215fd684... E Pulling node1 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling node1 ... done E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling node2 ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling node2 ... digest: sha256:2ea9da862c215fd684... E Pulling node2 ... status: image is up to date for a... E Pulling node2 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _ ERROR at setup of test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_after_op-zero_copy_lock_zk_fail_after_op] _ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster.add_instance( "node1", main_configs=["configs/config.d/s3.xml"], macros={"replica": "1"}, with_minio=True, with_zookeeper=True, ) cluster.add_instance( "node2", main_configs=["configs/config.d/s3.xml"], macros={"replica": "2"}, with_minio=True, with_zookeeper=True, ) logging.info("Starting cluster...") > cluster.start() test_s3_zero_copy_replication/test.py:34: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling zoo3 ... E Pulling zoo2 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling minio1 ... E Pulling node1 ... E Pulling node2 ... E Pulling resolver ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling node1 ... digest: sha256:2ea9da862c215fd684... E Pulling node1 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling node1 ... done E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling node2 ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling node2 ... digest: sha256:2ea9da862c215fd684... E Pulling node2 ... status: image is up to date for a... E Pulling node2 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _ ERROR at setup of test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_after_op-zero_copy_lock_zk_fail_before_op] _ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster.add_instance( "node1", main_configs=["configs/config.d/s3.xml"], macros={"replica": "1"}, with_minio=True, with_zookeeper=True, ) cluster.add_instance( "node2", main_configs=["configs/config.d/s3.xml"], macros={"replica": "2"}, with_minio=True, with_zookeeper=True, ) logging.info("Starting cluster...") > cluster.start() test_s3_zero_copy_replication/test.py:34: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling zoo3 ... E Pulling zoo2 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling minio1 ... E Pulling node1 ... E Pulling node2 ... E Pulling resolver ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling node1 ... digest: sha256:2ea9da862c215fd684... E Pulling node1 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling node1 ... done E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling node2 ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling node2 ... digest: sha256:2ea9da862c215fd684... E Pulling node2 ... status: image is up to date for a... E Pulling node2 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _ ERROR at setup of test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_before_op-zero_copy_lock_zk_fail_after_op] _ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster.add_instance( "node1", main_configs=["configs/config.d/s3.xml"], macros={"replica": "1"}, with_minio=True, with_zookeeper=True, ) cluster.add_instance( "node2", main_configs=["configs/config.d/s3.xml"], macros={"replica": "2"}, with_minio=True, with_zookeeper=True, ) logging.info("Starting cluster...") > cluster.start() test_s3_zero_copy_replication/test.py:34: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling zoo3 ... E Pulling zoo2 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling minio1 ... E Pulling node1 ... E Pulling node2 ... E Pulling resolver ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling node1 ... digest: sha256:2ea9da862c215fd684... E Pulling node1 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling node1 ... done E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling node2 ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling node2 ... digest: sha256:2ea9da862c215fd684... E Pulling node2 ... status: image is up to date for a... E Pulling node2 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _ ERROR at setup of test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_before_op-zero_copy_lock_zk_fail_before_op] _ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster.add_instance( "node1", main_configs=["configs/config.d/s3.xml"], macros={"replica": "1"}, with_minio=True, with_zookeeper=True, ) cluster.add_instance( "node2", main_configs=["configs/config.d/s3.xml"], macros={"replica": "2"}, with_minio=True, with_zookeeper=True, ) logging.info("Starting cluster...") > cluster.start() test_s3_zero_copy_replication/test.py:34: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling zoo3 ... E Pulling zoo2 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling minio1 ... E Pulling node1 ... E Pulling node2 ... E Pulling resolver ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling node1 ... digest: sha256:2ea9da862c215fd684... E Pulling node1 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling node1 ... done E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling node2 ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling node2 ... digest: sha256:2ea9da862c215fd684... E Pulling node2 ... status: image is up to date for a... E Pulling node2 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _____________ ERROR at setup of test_s3_zero_copy_concurrent_merge _____________ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster.add_instance( "node1", main_configs=["configs/config.d/s3.xml"], macros={"replica": "1"}, with_minio=True, with_zookeeper=True, ) cluster.add_instance( "node2", main_configs=["configs/config.d/s3.xml"], macros={"replica": "2"}, with_minio=True, with_zookeeper=True, ) logging.info("Starting cluster...") > cluster.start() test_s3_zero_copy_replication/test.py:34: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling zoo3 ... E Pulling zoo2 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling minio1 ... E Pulling node1 ... E Pulling node2 ... E Pulling resolver ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling node1 ... digest: sha256:2ea9da862c215fd684... E Pulling node1 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling node1 ... done E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling node2 ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling node2 ... digest: sha256:2ea9da862c215fd684... E Pulling node2 ... status: image is up to date for a... E Pulling node2 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ___________ ERROR at setup of test_s3_zero_copy_drop_detached_alter ____________ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster.add_instance( "node1", main_configs=["configs/config.d/s3.xml"], macros={"replica": "1"}, with_minio=True, with_zookeeper=True, ) cluster.add_instance( "node2", main_configs=["configs/config.d/s3.xml"], macros={"replica": "2"}, with_minio=True, with_zookeeper=True, ) logging.info("Starting cluster...") > cluster.start() test_s3_zero_copy_replication/test.py:34: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling zoo3 ... E Pulling zoo2 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling minio1 ... E Pulling node1 ... E Pulling node2 ... E Pulling resolver ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling node1 ... digest: sha256:2ea9da862c215fd684... E Pulling node1 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling node1 ... done E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling node2 ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling node2 ... digest: sha256:2ea9da862c215fd684... E Pulling node2 ... status: image is up to date for a... E Pulling node2 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ___________ ERROR at setup of test_s3_zero_copy_drop_detached_system ___________ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster.add_instance( "node1", main_configs=["configs/config.d/s3.xml"], macros={"replica": "1"}, with_minio=True, with_zookeeper=True, ) cluster.add_instance( "node2", main_configs=["configs/config.d/s3.xml"], macros={"replica": "2"}, with_minio=True, with_zookeeper=True, ) logging.info("Starting cluster...") > cluster.start() test_s3_zero_copy_replication/test.py:34: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling zoo3 ... E Pulling zoo2 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling minio1 ... E Pulling node1 ... E Pulling node2 ... E Pulling resolver ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling node1 ... digest: sha256:2ea9da862c215fd684... E Pulling node1 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling node1 ... done E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling node2 ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling node2 ... digest: sha256:2ea9da862c215fd684... E Pulling node2 ... status: image is up to date for a... E Pulling node2 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ________ ERROR at setup of test_s3_zero_copy_keeps_data_after_mutation _________ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster.add_instance( "node1", main_configs=["configs/config.d/s3.xml"], macros={"replica": "1"}, with_minio=True, with_zookeeper=True, ) cluster.add_instance( "node2", main_configs=["configs/config.d/s3.xml"], macros={"replica": "2"}, with_minio=True, with_zookeeper=True, ) logging.info("Starting cluster...") > cluster.start() test_s3_zero_copy_replication/test.py:34: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling zoo3 ... E Pulling zoo2 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling minio1 ... E Pulling node1 ... E Pulling node2 ... E Pulling resolver ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling node1 ... digest: sha256:2ea9da862c215fd684... E Pulling node1 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling node1 ... done E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling node2 ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling node2 ... digest: sha256:2ea9da862c215fd684... E Pulling node2 ... status: image is up to date for a... E Pulling node2 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ______________ ERROR at setup of test_s3_zero_copy_unfreeze_alter ______________ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster.add_instance( "node1", main_configs=["configs/config.d/s3.xml"], macros={"replica": "1"}, with_minio=True, with_zookeeper=True, ) cluster.add_instance( "node2", main_configs=["configs/config.d/s3.xml"], macros={"replica": "2"}, with_minio=True, with_zookeeper=True, ) logging.info("Starting cluster...") > cluster.start() test_s3_zero_copy_replication/test.py:34: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling zoo3 ... E Pulling zoo2 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling minio1 ... E Pulling node1 ... E Pulling node2 ... E Pulling resolver ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling node1 ... digest: sha256:2ea9da862c215fd684... E Pulling node1 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling node1 ... done E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling node2 ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling node2 ... digest: sha256:2ea9da862c215fd684... E Pulling node2 ... status: image is up to date for a... E Pulling node2 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _____________ ERROR at setup of test_s3_zero_copy_unfreeze_system ______________ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster.add_instance( "node1", main_configs=["configs/config.d/s3.xml"], macros={"replica": "1"}, with_minio=True, with_zookeeper=True, ) cluster.add_instance( "node2", main_configs=["configs/config.d/s3.xml"], macros={"replica": "2"}, with_minio=True, with_zookeeper=True, ) logging.info("Starting cluster...") > cluster.start() test_s3_zero_copy_replication/test.py:34: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling zoo3 ... E Pulling zoo2 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling minio1 ... E Pulling node1 ... E Pulling node2 ... E Pulling resolver ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling node1 ... digest: sha256:2ea9da862c215fd684... E Pulling node1 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling node1 ... done E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling node2 ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling node2 ... digest: sha256:2ea9da862c215fd684... E Pulling node2 ... status: image is up to date for a... E Pulling node2 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ________ ERROR at setup of test_s3_zero_copy_with_ttl_delete[False-10] _________ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster.add_instance( "node1", main_configs=["configs/config.d/s3.xml"], macros={"replica": "1"}, with_minio=True, with_zookeeper=True, ) cluster.add_instance( "node2", main_configs=["configs/config.d/s3.xml"], macros={"replica": "2"}, with_minio=True, with_zookeeper=True, ) logging.info("Starting cluster...") > cluster.start() test_s3_zero_copy_replication/test.py:34: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling zoo3 ... E Pulling zoo2 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling minio1 ... E Pulling node1 ... E Pulling node2 ... E Pulling resolver ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling node1 ... digest: sha256:2ea9da862c215fd684... E Pulling node1 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling node1 ... done E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling node2 ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling node2 ... digest: sha256:2ea9da862c215fd684... E Pulling node2 ... status: image is up to date for a... E Pulling node2 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _________ ERROR at setup of test_s3_zero_copy_with_ttl_delete[True-3] __________ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster.add_instance( "node1", main_configs=["configs/config.d/s3.xml"], macros={"replica": "1"}, with_minio=True, with_zookeeper=True, ) cluster.add_instance( "node2", main_configs=["configs/config.d/s3.xml"], macros={"replica": "2"}, with_minio=True, with_zookeeper=True, ) logging.info("Starting cluster...") > cluster.start() test_s3_zero_copy_replication/test.py:34: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling zoo3 ... E Pulling zoo2 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling minio1 ... E Pulling node1 ... E Pulling node2 ... E Pulling resolver ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling node1 ... digest: sha256:2ea9da862c215fd684... E Pulling node1 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling node1 ... done E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling node2 ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling node2 ... digest: sha256:2ea9da862c215fd684... E Pulling node2 ... status: image is up to date for a... E Pulling node2 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ______ ERROR at setup of test_s3_zero_copy_with_ttl_move[tiered-False-10] ______ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster.add_instance( "node1", main_configs=["configs/config.d/s3.xml"], macros={"replica": "1"}, with_minio=True, with_zookeeper=True, ) cluster.add_instance( "node2", main_configs=["configs/config.d/s3.xml"], macros={"replica": "2"}, with_minio=True, with_zookeeper=True, ) logging.info("Starting cluster...") > cluster.start() test_s3_zero_copy_replication/test.py:34: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling zoo3 ... E Pulling zoo2 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling minio1 ... E Pulling node1 ... E Pulling node2 ... E Pulling resolver ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling node1 ... digest: sha256:2ea9da862c215fd684... E Pulling node1 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling node1 ... done E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling node2 ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling node2 ... digest: sha256:2ea9da862c215fd684... E Pulling node2 ... status: image is up to date for a... E Pulling node2 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _______ ERROR at setup of test_s3_zero_copy_with_ttl_move[tiered-True-3] _______ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster.add_instance( "node1", main_configs=["configs/config.d/s3.xml"], macros={"replica": "1"}, with_minio=True, with_zookeeper=True, ) cluster.add_instance( "node2", main_configs=["configs/config.d/s3.xml"], macros={"replica": "2"}, with_minio=True, with_zookeeper=True, ) logging.info("Starting cluster...") > cluster.start() test_s3_zero_copy_replication/test.py:34: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling zoo3 ... E Pulling zoo2 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling minio1 ... E Pulling node1 ... E Pulling node2 ... E Pulling resolver ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling node1 ... digest: sha256:2ea9da862c215fd684... E Pulling node1 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling node1 ... done E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling node2 ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling node2 ... digest: sha256:2ea9da862c215fd684... E Pulling node2 ... status: image is up to date for a... E Pulling node2 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ___ ERROR at setup of test_s3_zero_copy_with_ttl_move[tiered_copy-False-10] ____ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster.add_instance( "node1", main_configs=["configs/config.d/s3.xml"], macros={"replica": "1"}, with_minio=True, with_zookeeper=True, ) cluster.add_instance( "node2", main_configs=["configs/config.d/s3.xml"], macros={"replica": "2"}, with_minio=True, with_zookeeper=True, ) logging.info("Starting cluster...") > cluster.start() test_s3_zero_copy_replication/test.py:34: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling zoo3 ... E Pulling zoo2 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling minio1 ... E Pulling node1 ... E Pulling node2 ... E Pulling resolver ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling node1 ... digest: sha256:2ea9da862c215fd684... E Pulling node1 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling node1 ... done E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling node2 ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling node2 ... digest: sha256:2ea9da862c215fd684... E Pulling node2 ... status: image is up to date for a... E Pulling node2 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ____ ERROR at setup of test_s3_zero_copy_with_ttl_move[tiered_copy-True-3] _____ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster.add_instance( "node1", main_configs=["configs/config.d/s3.xml"], macros={"replica": "1"}, with_minio=True, with_zookeeper=True, ) cluster.add_instance( "node2", main_configs=["configs/config.d/s3.xml"], macros={"replica": "2"}, with_minio=True, with_zookeeper=True, ) logging.info("Starting cluster...") > cluster.start() test_s3_zero_copy_replication/test.py:34: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling zoo3 ... E Pulling zoo2 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling minio1 ... E Pulling node1 ... E Pulling node2 ... E Pulling resolver ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling node1 ... digest: sha256:2ea9da862c215fd684... E Pulling node1 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling node1 ... done E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling node2 ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling node2 ... digest: sha256:2ea9da862c215fd684... E Pulling node2 ... status: image is up to date for a... E Pulling node2 ... done E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _ ERROR at setup of test_all_projection_files_are_dropped_when_part_is_dropped _ [gw7] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) kwargs = args_to_dict( main_configs=[ "configs/config.d/storage_conf.xml", ], user_configs=[ "configs/config.d/users.xml", ], with_minio=True, with_zookeeper=True, stay_alive=True, ) cluster.add_instance("node1", **kwargs) cluster.add_instance("node2", **kwargs) > cluster.start() test_replicated_zero_copy_projection_mutation/test.py:37: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling zoo1 ... E Pulling zoo3 ... E Pulling minio1 ... E Pulling node1 ... E Pulling node2 ... E Pulling node2 ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling node1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling node2 ... digest: sha256:2ea9da862c215fd684... E Pulling node2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling node2 ... done E Pulling zoo2 ... done E Pulling node1 ... digest: sha256:2ea9da862c215fd684... E Pulling node1 ... status: image is up to date for a... E Pulling node1 ... done E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling resolver ... done E Pulling zoo1 ... done E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ---------------------------- Captured stdout setup ----------------------------- Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml ---------------------------- Captured stderr setup ----------------------------- Command:['docker ps | wc -l'] Command:['docker ps | wc -l'] Stdout:1 Stdout:1 No running containers No running containers Pruning Docker networks Pruning Docker networks Command:['docker network prune --force'] Command:['docker network prune --force'] Command:["sysctl net.ipv4.ip_local_port_range='55000 65535'"] Command:["sysctl net.ipv4.ip_local_port_range='55000 65535'"] Stdout:net.ipv4.ip_local_port_range = 55000 65535 Stdout:net.ipv4.ip_local_port_range = 55000 65535 ENV DOCKER_KERBEROS_KDC_TAG 9391ecdee8d7 ENV DOCKER_KERBEROS_KDC_TAG 9391ecdee8d7 ENV CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse ENV CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse ENV MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 ENV MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 ENV JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true ENV JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true ENV TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 ENV TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 ENV HOSTNAME 8a1c44ceac15 ENV HOSTNAME 8a1c44ceac15 ENV SHLVL 0 ENV SHLVL 0 ENV HOME /root ENV HOME /root ENV OLDPWD / ENV OLDPWD / ENV DOCKER_HELPER_TAG 2cffe1eae894 ENV DOCKER_HELPER_TAG 2cffe1eae894 ENV PYTHONUNBUFFERED 1 ENV PYTHONUNBUFFERED 1 ENV DOCKER_PYTHON_BOTTLE_TAG caad4729259e ENV DOCKER_PYTHON_BOTTLE_TAG caad4729259e ENV UBSAN_OPTIONS print_stacktrace=1 ENV UBSAN_OPTIONS print_stacktrace=1 ENV PYTEST_ADDOPTS --dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-10-100000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-1000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-10000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-100000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-1000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-10000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-100000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-1000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-10000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-100000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-key-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-key-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-sipHash64(key)-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-sipHash64(key)-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-key-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-key-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-sipHash64(key)-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-sipHash64(key)-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-key-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-key-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-sipHash64(key)-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-sipHash64(key)-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-key-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-key-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-sipHash64(key)-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-sipHash64(key)-1]' test_relative_filepath/test.py::test_filepath test_reload_clusters_config/test.py::test_add_cluster test_reload_clusters_config/test.py::test_delete_cluster test_reload_clusters_config/test.py::test_simple_reload test_reload_clusters_config/test.py::test_update_one_cluster test_replica_can_become_leader/test.py::test_can_become_leader test_replica_is_active/test.py::test_replica_is_active test_replicated_merge_tree_thread_schedule_timeouts/test.py::test_query_exception_on_thread_pool_full test_replicated_zero_copy_projection_mutation/test.py::test_all_projection_files_are_dropped_when_part_is_dropped test_replicated_zero_copy_projection_mutation/test.py::test_hardlinks_preserved_when_projection_dropped test_restore_replica/test.py::test_restore_replica_alive_replicas test_restore_replica/test.py::test_restore_replica_invalid_tables test_restore_replica/test.py::test_restore_replica_parallel test_restore_replica/test.py::test_restore_replica_sequential test_s3_storage_class/test.py::test_s3_storage_class_right 'test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[None-zero_copy_lock_zk_fail_after_op]' 'test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[None-zero_copy_lock_zk_fail_before_op]' 'test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_after_op-zero_copy_lock_zk_fail_after_op]' 'test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_after_op-zero_copy_lock_zk_fail_before_op]' 'test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_before_op-zero_copy_lock_zk_fail_after_op]' 'test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_before_op-zero_copy_lock_zk_fail_before_op]' test_s3_zero_copy_replication/test.py::test_s3_zero_copy_concurrent_merge test_s3_zero_copy_replication/test.py::test_s3_zero_copy_drop_detached_alter test_s3_zero_copy_replication/test.py::test_s3_zero_copy_drop_detached_system test_s3_zero_copy_replication/test.py::test_s3_zero_copy_keeps_data_after_mutation 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_replication[s3]' test_s3_zero_copy_replication/test.py::test_s3_zero_copy_unfreeze_alter test_s3_zero_copy_replication/test.py::test_s3_zero_copy_unfreeze_system 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_delete[False-10]' 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_delete[True-3]' 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered-False-10]' 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered-True-3]' 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered_copy-False-10]' 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered_copy-True-3]' test_scheduler/test.py::test_merge_workload test_scheduler/test.py::test_merge_workload_change test_scheduler/test.py::test_merge_workload_override test_scheduler/test.py::test_mutate_workload test_scheduler/test.py::test_mutation_workload_change test_scheduler/test.py::test_mutation_workload_override test_scheduler/test.py::test_s3_disk test_secure_socket/test.py::test test_send_crash_reports/test.py::test_send_segfault test_server_initialization/test.py::test_partially_dropped_tables test_server_initialization/test.py::test_sophisticated_default test_server_start_and_ip_conversions/test.py::test_restart_success_ipv4 test_server_start_and_ip_conversions/test.py::test_restart_success_ipv6 test_storage_azure_blob_storage/test.py::test_azure_glob_scheherazade test_storage_azure_blob_storage/test.py::test_create_new_files_on_insert test_storage_azure_blob_storage/test.py::test_create_table_account_string test_storage_azure_blob_storage/test.py::test_create_table_connection_string test_storage_azure_blob_storage/test.py::test_filter_using_file test_storage_azure_blob_storage/test.py::test_filtering_by_file_or_path test_storage_azure_blob_storage/test.py::test_format_detection test_storage_azure_blob_storage/test.py::test_function_signatures test_storage_azure_blob_storage/test.py::test_hive_partitioning_with_all_parameters test_storage_azure_blob_storage/test.py::test_hive_partitioning_with_one_parameter test_storage_azure_blob_storage/test.py::test_hive_partitioning_without_setting test_storage_azure_blob_storage/test.py::test_insert_create_new_file test_storage_azure_blob_storage/test.py::test_insert_with_path_with_globs test_storage_azure_blob_storage/test.py::test_overwrite test_storage_azure_blob_storage/test.py::test_parallel_read test_storage_azure_blob_storage/test.py::test_partition_by test_storage_azure_blob_storage/test.py::test_partition_by_const_column test_storage_azure_blob_storage/test.py::test_partition_by_string_column -vvv ENV PYTEST_ADDOPTS --dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-10-100000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-1000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-10000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-100000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-1000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-10000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-100000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-1000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-10000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-100000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-key-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-key-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-sipHash64(key)-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-sipHash64(key)-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-key-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-key-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-sipHash64(key)-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-sipHash64(key)-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-key-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-key-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-sipHash64(key)-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-sipHash64(key)-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-key-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-key-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-sipHash64(key)-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-sipHash64(key)-1]' test_relative_filepath/test.py::test_filepath test_reload_clusters_config/test.py::test_add_cluster test_reload_clusters_config/test.py::test_delete_cluster test_reload_clusters_config/test.py::test_simple_reload test_reload_clusters_config/test.py::test_update_one_cluster test_replica_can_become_leader/test.py::test_can_become_leader test_replica_is_active/test.py::test_replica_is_active test_replicated_merge_tree_thread_schedule_timeouts/test.py::test_query_exception_on_thread_pool_full test_replicated_zero_copy_projection_mutation/test.py::test_all_projection_files_are_dropped_when_part_is_dropped test_replicated_zero_copy_projection_mutation/test.py::test_hardlinks_preserved_when_projection_dropped test_restore_replica/test.py::test_restore_replica_alive_replicas test_restore_replica/test.py::test_restore_replica_invalid_tables test_restore_replica/test.py::test_restore_replica_parallel test_restore_replica/test.py::test_restore_replica_sequential test_s3_storage_class/test.py::test_s3_storage_class_right 'test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[None-zero_copy_lock_zk_fail_after_op]' 'test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[None-zero_copy_lock_zk_fail_before_op]' 'test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_after_op-zero_copy_lock_zk_fail_after_op]' 'test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_after_op-zero_copy_lock_zk_fail_before_op]' 'test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_before_op-zero_copy_lock_zk_fail_after_op]' 'test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_before_op-zero_copy_lock_zk_fail_before_op]' test_s3_zero_copy_replication/test.py::test_s3_zero_copy_concurrent_merge test_s3_zero_copy_replication/test.py::test_s3_zero_copy_drop_detached_alter test_s3_zero_copy_replication/test.py::test_s3_zero_copy_drop_detached_system test_s3_zero_copy_replication/test.py::test_s3_zero_copy_keeps_data_after_mutation 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_replication[s3]' test_s3_zero_copy_replication/test.py::test_s3_zero_copy_unfreeze_alter test_s3_zero_copy_replication/test.py::test_s3_zero_copy_unfreeze_system 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_delete[False-10]' 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_delete[True-3]' 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered-False-10]' 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered-True-3]' 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered_copy-False-10]' 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered_copy-True-3]' test_scheduler/test.py::test_merge_workload test_scheduler/test.py::test_merge_workload_change test_scheduler/test.py::test_merge_workload_override test_scheduler/test.py::test_mutate_workload test_scheduler/test.py::test_mutation_workload_change test_scheduler/test.py::test_mutation_workload_override test_scheduler/test.py::test_s3_disk test_secure_socket/test.py::test test_send_crash_reports/test.py::test_send_segfault test_server_initialization/test.py::test_partially_dropped_tables test_server_initialization/test.py::test_sophisticated_default test_server_start_and_ip_conversions/test.py::test_restart_success_ipv4 test_server_start_and_ip_conversions/test.py::test_restart_success_ipv6 test_storage_azure_blob_storage/test.py::test_azure_glob_scheherazade test_storage_azure_blob_storage/test.py::test_create_new_files_on_insert test_storage_azure_blob_storage/test.py::test_create_table_account_string test_storage_azure_blob_storage/test.py::test_create_table_connection_string test_storage_azure_blob_storage/test.py::test_filter_using_file test_storage_azure_blob_storage/test.py::test_filtering_by_file_or_path test_storage_azure_blob_storage/test.py::test_format_detection test_storage_azure_blob_storage/test.py::test_function_signatures test_storage_azure_blob_storage/test.py::test_hive_partitioning_with_all_parameters test_storage_azure_blob_storage/test.py::test_hive_partitioning_with_one_parameter test_storage_azure_blob_storage/test.py::test_hive_partitioning_without_setting test_storage_azure_blob_storage/test.py::test_insert_create_new_file test_storage_azure_blob_storage/test.py::test_insert_with_path_with_globs test_storage_azure_blob_storage/test.py::test_overwrite test_storage_azure_blob_storage/test.py::test_parallel_read test_storage_azure_blob_storage/test.py::test_partition_by test_storage_azure_blob_storage/test.py::test_partition_by_const_column test_storage_azure_blob_storage/test.py::test_partition_by_string_column -vvv ENV CLICKHOUSE_LIBRARY_BRIDGE_BINARY_PATH /clickhouse-library-bridge ENV CLICKHOUSE_LIBRARY_BRIDGE_BINARY_PATH /clickhouse-library-bridge ENV COMPOSE_HTTP_TIMEOUT 600 ENV COMPOSE_HTTP_TIMEOUT 600 ENV DOCKER_MYSQL_PHP_CLIENT_TAG 88be89c1e3b6 ENV DOCKER_MYSQL_PHP_CLIENT_TAG 88be89c1e3b6 ENV DOCKER_DOTNET_CLIENT_TAG 11de0b29a15d ENV DOCKER_DOTNET_CLIENT_TAG 11de0b29a15d ENV CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse ENV CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse ENV DOCKER_MYSQL_JS_CLIENT_TAG 41ba7c2ec2a1 ENV DOCKER_MYSQL_JS_CLIENT_TAG 41ba7c2ec2a1 ENV PATH /spark-3.3.2-bin-hadoop3/bin:/opt/gdb/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin ENV PATH /spark-3.3.2-bin-hadoop3/bin:/opt/gdb/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin ENV DOCKER_KERBERIZED_HADOOP_TAG latest ENV DOCKER_KERBERIZED_HADOOP_TAG latest ENV DOCKER_CHANNEL stable ENV DOCKER_CHANNEL stable ENV DOCKER_CLIENT_TIMEOUT 300 ENV DOCKER_CLIENT_TIMEOUT 300 ENV DOCKER_POSTGRESQL_JAVA_CLIENT_TAG a4eff5c7f4d6 ENV DOCKER_POSTGRESQL_JAVA_CLIENT_TAG a4eff5c7f4d6 ENV DOCKER_NGINX_DAV_TAG b55ac9cd7519 ENV DOCKER_NGINX_DAV_TAG b55ac9cd7519 ENV DOCKER_MYSQL_GOLANG_CLIENT_TAG 9bec2a638e6e ENV DOCKER_MYSQL_GOLANG_CLIENT_TAG 9bec2a638e6e ENV PWD /ClickHouse/tests/integration ENV PWD /ClickHouse/tests/integration ENV DOCKER_MYSQL_JAVA_CLIENT_TAG 766bff31cfe4 ENV DOCKER_MYSQL_JAVA_CLIENT_TAG 766bff31cfe4 ENV CLICKHOUSE_ODBC_BRIDGE_BINARY_PATH /clickhouse-odbc-bridge ENV CLICKHOUSE_ODBC_BRIDGE_BINARY_PATH /clickhouse-odbc-bridge ENV CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config ENV CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config ENV TZ Etc/UTC ENV TZ Etc/UTC ENV JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java ENV JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java ENV DOCKER_BASE_TAG b74d853ebe76 ENV DOCKER_BASE_TAG b74d853ebe76 ENV SPARK_HOME /spark-3.3.2-bin-hadoop3 ENV SPARK_HOME /spark-3.3.2-bin-hadoop3 ENV LC_CTYPE C.UTF-8 ENV LC_CTYPE C.UTF-8 ENV INTEGRATION_TESTS_RUN_ID 0 ENV INTEGRATION_TESTS_RUN_ID 0 ENV WORKER_FREE_PORTS 30350 30351 30352 30353 30354 30355 30356 30357 30358 30359 30360 30361 30362 30363 30364 30365 30366 30367 30368 30369 30370 30371 30372 30373 30374 30375 30376 30377 30378 30379 30380 30381 30382 30383 30384 30385 30386 30387 30388 30389 30390 30391 30392 30393 30394 30395 30396 30397 30398 30399 ENV WORKER_FREE_PORTS 30350 30351 30352 30353 30354 30355 30356 30357 30358 30359 30360 30361 30362 30363 30364 30365 30366 30367 30368 30369 30370 30371 30372 30373 30374 30375 30376 30377 30378 30379 30380 30381 30382 30383 30384 30385 30386 30387 30388 30389 30390 30391 30392 30393 30394 30395 30396 30397 30398 30399 ENV PYTEST_XDIST_TESTRUNUID 203ac44cc76f42ab958527e478875f97 ENV PYTEST_XDIST_TESTRUNUID 203ac44cc76f42ab958527e478875f97 ENV PYTEST_XDIST_WORKER gw7 ENV PYTEST_XDIST_WORKER gw7 ENV PYTEST_XDIST_WORKER_COUNT 10 ENV PYTEST_XDIST_WORKER_COUNT 10 ENV PYTEST_CURRENT_TEST test_replicated_zero_copy_projection_mutation/test.py::test_all_projection_files_are_dropped_when_part_is_dropped (setup) ENV PYTEST_CURRENT_TEST test_replicated_zero_copy_projection_mutation/test.py::test_all_projection_files_are_dropped_when_part_is_dropped (setup) CLUSTER INIT base_config_dir:/clickhouse-config CLUSTER INIT base_config_dir:/clickhouse-config clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log Setup Keeper Setup Keeper Cluster name: project_name:roottestreplicatedzerocopyprojectionmutation_gw7. Added instance name:node1 tag:b74d853ebe76 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ Cluster name: project_name:roottestreplicatedzerocopyprojectionmutation_gw7. Added instance name:node1 tag:b74d853ebe76 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log Cluster name: project_name:roottestreplicatedzerocopyprojectionmutation_gw7. Added instance name:node2 tag:b74d853ebe76 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ Cluster name: project_name:roottestreplicatedzerocopyprojectionmutation_gw7. Added instance name:node2 tag:b74d853ebe76 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ Running tests in /ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/test.py Running tests in /ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/test.py Cluster start called. is_up=False Cluster start called. is_up=False Docker networks for project roottestreplicatedzerocopyprojectionmutation_gw7 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreplicatedzerocopyprojectionmutation_gw7 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestreplicatedzerocopyprojectionmutation_gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreplicatedzerocopyprojectionmutation_gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestreplicatedzerocopyprojectionmutation_gw7 are DRIVER VOLUME NAME Docker volumes for project roottestreplicatedzerocopyprojectionmutation_gw7 are DRIVER VOLUME NAME Cleanup called Cleanup called Docker networks for project roottestreplicatedzerocopyprojectionmutation_gw7 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreplicatedzerocopyprojectionmutation_gw7 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestreplicatedzerocopyprojectionmutation_gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreplicatedzerocopyprojectionmutation_gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestreplicatedzerocopyprojectionmutation_gw7 are DRIVER VOLUME NAME Docker volumes for project roottestreplicatedzerocopyprojectionmutation_gw7 are DRIVER VOLUME NAME Command:docker container list --all --filter name='^/roottestreplicatedzerocopyprojectionmutation_gw7_.*_1$' --format '{{.ID}}:{{.Names}}' Command:docker container list --all --filter name='^/roottestreplicatedzerocopyprojectionmutation_gw7_.*_1$' --format '{{.ID}}:{{.Names}}' Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestreplicatedzerocopyprojectionmutation_gw7 No running containers for project: roottestreplicatedzerocopyprojectionmutation_gw7 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused volumes... Trying to prune unused volumes... Command:['docker volume ls | wc -l'] Command:['docker volume ls | wc -l'] Stdout:1 Stdout:1 Setup directory for instance: node1 Setup directory for instance: node1 Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/configs/config.d/storage_conf.xml'] to /ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/configs/config.d/storage_conf.xml'] to /ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/configs/config.d Setup database dir /ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/database Setup database dir /ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/database Setup logs dir /ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/logs Setup logs dir /ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/logs Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon; coproc tail -f /dev/null; wait $$!" Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon; coproc tail -f /dev/null; wait $$!" Setup directory for instance: node2 Setup directory for instance: node2 Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/configs/config.d/storage_conf.xml'] to /ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/configs/config.d/storage_conf.xml'] to /ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/configs/config.d Setup database dir /ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/database Setup database dir /ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/database Setup logs dir /ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/logs Setup logs dir /ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/logs Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon; coproc tail -f /dev/null; wait $$!" Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon; coproc tail -f /dev/null; wait $$!" Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:b74d853ebe76', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/keeper3/coordination', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/minio/certs/public.crt'} stored in /ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:b74d853ebe76', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/keeper3/coordination', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/minio/certs/public.crt'} stored in /ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found http://localhost:None "GET /version HTTP/1.1" 200 825 http://localhost:None "GET /version HTTP/1.1" 200 825 Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] Stderr:Pulling zoo1 ... Stderr:Pulling zoo1 ... Stderr:Pulling zoo2 ... Stderr:Pulling zoo2 ... Stderr:Pulling proxy2 ... Stderr:Pulling proxy2 ... Stderr:Pulling zoo3 ... Stderr:Pulling zoo3 ... Stderr:Pulling proxy1 ... Stderr:Pulling proxy1 ... Stderr:Pulling resolver ... Stderr:Pulling resolver ... Stderr:Pulling minio1 ... Stderr:Pulling minio1 ... Stderr:Pulling node1 ... Stderr:Pulling node1 ... Stderr:Pulling node2 ... Stderr:Pulling node2 ... Stderr:Pulling node1 ... pulling from altinityinfra/integr... Stderr:Pulling node1 ... pulling from altinityinfra/integr... Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling node2 ... pulling from altinityinfra/integr... Stderr:Pulling node2 ... pulling from altinityinfra/integr... Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node1 ... status: image is up to date for a... Stderr:Pulling node1 ... status: image is up to date for a... Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo2 ... status: image is up to date for a... Stderr:Pulling zoo2 ... status: image is up to date for a... Stderr:Pulling node1 ... done Stderr:Pulling node1 ... done Stderr:Pulling zoo2 ... done Stderr:Pulling zoo2 ... done Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo1 ... status: image is up to date for a... Stderr:Pulling zoo1 ... status: image is up to date for a... Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling resolver ... done Stderr:Pulling resolver ... done Stderr:Pulling zoo1 ... done Stderr:Pulling zoo1 ... done Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node2 ... status: image is up to date for a... Stderr:Pulling node2 ... status: image is up to date for a... Stderr:Pulling node2 ... done Stderr:Pulling node2 ... done Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo3 ... status: image is up to date for a... Stderr:Pulling zoo3 ... status: image is up to date for a... Stderr:Pulling proxy2 ... done Stderr:Pulling proxy2 ... done Stderr:Pulling zoo3 ... done Stderr:Pulling zoo3 ... done Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... done Stderr:Pulling proxy1 ... done Stderr:Pulling minio1 ... error Stderr:Pulling minio1 ... error Stderr: Stderr: Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Exitcode:1 Exitcode:1 Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo1 ... Pulling zoo2 ... Pulling proxy2 ... Pulling zoo3 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node1 ... Pulling node2 ... Pulling node1 ... pulling from altinityinfra/integr... Pulling zoo2 ... pulling from altinityinfra/integr... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling node2 ... pulling from altinityinfra/integr... Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling node1 ... done Pulling zoo2 ... done Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling zoo1 ... done Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling node2 ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling zoo3 ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling proxy2 ... done Pulling zoo3 ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo1 ... Pulling zoo2 ... Pulling proxy2 ... Pulling zoo3 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node1 ... Pulling node2 ... Pulling node1 ... pulling from altinityinfra/integr... Pulling zoo2 ... pulling from altinityinfra/integr... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling node2 ... pulling from altinityinfra/integr... Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling node1 ... done Pulling zoo2 ... done Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling zoo1 ... done Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling node2 ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling zoo3 ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling proxy2 ... done Pulling zoo3 ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] Stderr:Pulling proxy1 ... Stderr:Pulling proxy1 ... Stderr:Pulling proxy2 ... Stderr:Pulling proxy2 ... Stderr:Pulling zoo2 ... Stderr:Pulling zoo2 ... Stderr:Pulling zoo3 ... Stderr:Pulling zoo3 ... Stderr:Pulling zoo1 ... Stderr:Pulling zoo1 ... Stderr:Pulling resolver ... Stderr:Pulling resolver ... Stderr:Pulling minio1 ... Stderr:Pulling minio1 ... Stderr:Pulling node2 ... Stderr:Pulling node2 ... Stderr:Pulling node1 ... Stderr:Pulling node1 ... Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo3 ... status: image is up to date for a... Stderr:Pulling zoo3 ... status: image is up to date for a... Stderr:Pulling zoo3 ... done Stderr:Pulling zoo3 ... done Stderr:Pulling node1 ... pulling from altinityinfra/integr... Stderr:Pulling node1 ... pulling from altinityinfra/integr... Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling resolver ... done Stderr:Pulling resolver ... done Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node1 ... status: image is up to date for a... Stderr:Pulling node1 ... status: image is up to date for a... Stderr:Pulling node1 ... done Stderr:Pulling node1 ... done Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... done Stderr:Pulling proxy1 ... done Stderr:Pulling minio1 ... error Stderr:Pulling minio1 ... error Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo2 ... status: image is up to date for a... Stderr:Pulling zoo2 ... status: image is up to date for a... Stderr:Pulling node2 ... pulling from altinityinfra/integr... Stderr:Pulling node2 ... pulling from altinityinfra/integr... Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling zoo2 ... done Stderr:Pulling zoo2 ... done Stderr:Pulling proxy2 ... done Stderr:Pulling proxy2 ... done Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo1 ... status: image is up to date for a... Stderr:Pulling zoo1 ... status: image is up to date for a... Stderr:Pulling zoo1 ... done Stderr:Pulling zoo1 ... done Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node2 ... status: image is up to date for a... Stderr:Pulling node2 ... status: image is up to date for a... Stderr:Pulling node2 ... done Stderr:Pulling node2 ... done Stderr: Stderr: Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Exitcode:1 Exitcode:1 Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling zoo2 ... Pulling zoo3 ... Pulling zoo1 ... Pulling resolver ... Pulling minio1 ... Pulling node2 ... Pulling node1 ... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling node1 ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling minio1 ... error Pulling zoo2 ... pulling from altinityinfra/integr... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling zoo1 ... pulling from altinityinfra/integr... Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling node2 ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling proxy2 ... done Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling node2 ... done ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling zoo2 ... Pulling zoo3 ... Pulling zoo1 ... Pulling resolver ... Pulling minio1 ... Pulling node2 ... Pulling node1 ... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling node1 ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling minio1 ... error Pulling zoo2 ... pulling from altinityinfra/integr... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling zoo1 ... pulling from altinityinfra/integr... Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling node2 ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling proxy2 ... done Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling node2 ... done ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] Stderr:Pulling proxy1 ... Stderr:Pulling proxy1 ... Stderr:Pulling proxy2 ... Stderr:Pulling proxy2 ... Stderr:Pulling resolver ... Stderr:Pulling resolver ... Stderr:Pulling minio1 ... Stderr:Pulling minio1 ... Stderr:Pulling zoo1 ... Stderr:Pulling zoo1 ... Stderr:Pulling zoo3 ... Stderr:Pulling zoo3 ... Stderr:Pulling zoo2 ... Stderr:Pulling zoo2 ... Stderr:Pulling node1 ... Stderr:Pulling node1 ... Stderr:Pulling node2 ... Stderr:Pulling node2 ... Stderr:Pulling node1 ... pulling from altinityinfra/integr... Stderr:Pulling node1 ... pulling from altinityinfra/integr... Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node1 ... status: image is up to date for a... Stderr:Pulling node1 ... status: image is up to date for a... Stderr:Pulling node1 ... done Stderr:Pulling node1 ... done Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo2 ... status: image is up to date for a... Stderr:Pulling zoo2 ... status: image is up to date for a... Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo1 ... status: image is up to date for a... Stderr:Pulling zoo1 ... status: image is up to date for a... Stderr:Pulling zoo2 ... done Stderr:Pulling zoo2 ... done Stderr:Pulling zoo1 ... done Stderr:Pulling zoo1 ... done Stderr:Pulling node2 ... pulling from altinityinfra/integr... Stderr:Pulling node2 ... pulling from altinityinfra/integr... Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node2 ... status: image is up to date for a... Stderr:Pulling node2 ... status: image is up to date for a... Stderr:Pulling node2 ... done Stderr:Pulling node2 ... done Stderr:Pulling minio1 ... error Stderr:Pulling minio1 ... error Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo3 ... status: image is up to date for a... Stderr:Pulling zoo3 ... status: image is up to date for a... Stderr:Pulling zoo3 ... done Stderr:Pulling zoo3 ... done Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling resolver ... done Stderr:Pulling resolver ... done Stderr:Pulling proxy2 ... done Stderr:Pulling proxy2 ... done Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... done Stderr:Pulling proxy1 ... done Stderr: Stderr: Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Exitcode:1 Exitcode:1 Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling zoo1 ... Pulling zoo3 ... Pulling zoo2 ... Pulling node1 ... Pulling node2 ... Pulling node1 ... pulling from altinityinfra/integr... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling zoo2 ... pulling from altinityinfra/integr... Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo2 ... done Pulling zoo1 ... done Pulling node2 ... pulling from altinityinfra/integr... Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling node2 ... done Pulling minio1 ... error Pulling zoo3 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling resolver ... done Pulling proxy2 ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling zoo1 ... Pulling zoo3 ... Pulling zoo2 ... Pulling node1 ... Pulling node2 ... Pulling node1 ... pulling from altinityinfra/integr... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling zoo2 ... pulling from altinityinfra/integr... Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo2 ... done Pulling zoo1 ... done Pulling node2 ... pulling from altinityinfra/integr... Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling node2 ... done Pulling minio1 ... error Pulling zoo3 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling resolver ... done Pulling proxy2 ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] Stderr:Pulling zoo1 ... Stderr:Pulling zoo1 ... Stderr:Pulling proxy1 ... Stderr:Pulling proxy1 ... Stderr:Pulling proxy2 ... Stderr:Pulling proxy2 ... Stderr:Pulling minio1 ... Stderr:Pulling minio1 ... Stderr:Pulling zoo3 ... Stderr:Pulling zoo3 ... Stderr:Pulling zoo2 ... Stderr:Pulling zoo2 ... Stderr:Pulling node2 ... Stderr:Pulling node2 ... Stderr:Pulling node1 ... Stderr:Pulling node1 ... Stderr:Pulling resolver ... Stderr:Pulling resolver ... Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo1 ... status: image is up to date for a... Stderr:Pulling zoo1 ... status: image is up to date for a... Stderr:Pulling zoo1 ... done Stderr:Pulling zoo1 ... done Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo3 ... status: image is up to date for a... Stderr:Pulling zoo3 ... status: image is up to date for a... Stderr:Pulling zoo3 ... done Stderr:Pulling zoo3 ... done Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... done Stderr:Pulling proxy2 ... done Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling resolver ... done Stderr:Pulling resolver ... done Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... done Stderr:Pulling proxy1 ... done Stderr:Pulling node2 ... pulling from altinityinfra/integr... Stderr:Pulling node2 ... pulling from altinityinfra/integr... Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node2 ... status: image is up to date for a... Stderr:Pulling node2 ... status: image is up to date for a... Stderr:Pulling node2 ... done Stderr:Pulling node2 ... done Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo2 ... status: image is up to date for a... Stderr:Pulling zoo2 ... status: image is up to date for a... Stderr:Pulling zoo2 ... done Stderr:Pulling zoo2 ... done Stderr:Pulling node1 ... pulling from altinityinfra/integr... Stderr:Pulling node1 ... pulling from altinityinfra/integr... Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node1 ... status: image is up to date for a... Stderr:Pulling node1 ... status: image is up to date for a... Stderr:Pulling node1 ... done Stderr:Pulling node1 ... done Stderr:Pulling minio1 ... error Stderr:Pulling minio1 ... error Stderr: Stderr: Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Exitcode:1 Exitcode:1 Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo1 ... Pulling proxy1 ... Pulling proxy2 ... Pulling minio1 ... Pulling zoo3 ... Pulling zoo2 ... Pulling node2 ... Pulling node1 ... Pulling resolver ... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling zoo3 ... pulling from altinityinfra/integr... Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling node2 ... pulling from altinityinfra/integr... Pulling zoo2 ... pulling from altinityinfra/integr... Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling node2 ... done Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling node1 ... pulling from altinityinfra/integr... Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo1 ... Pulling proxy1 ... Pulling proxy2 ... Pulling minio1 ... Pulling zoo3 ... Pulling zoo2 ... Pulling node2 ... Pulling node1 ... Pulling resolver ... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling zoo3 ... pulling from altinityinfra/integr... Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling node2 ... pulling from altinityinfra/integr... Pulling zoo2 ... pulling from altinityinfra/integr... Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling node2 ... done Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling node1 ... pulling from altinityinfra/integr... Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] Stderr:Pulling zoo2 ... Stderr:Pulling zoo2 ... Stderr:Pulling proxy2 ... Stderr:Pulling proxy2 ... Stderr:Pulling proxy1 ... Stderr:Pulling proxy1 ... Stderr:Pulling resolver ... Stderr:Pulling resolver ... Stderr:Pulling zoo1 ... Stderr:Pulling zoo1 ... Stderr:Pulling zoo3 ... Stderr:Pulling zoo3 ... Stderr:Pulling minio1 ... Stderr:Pulling minio1 ... Stderr:Pulling node1 ... Stderr:Pulling node1 ... Stderr:Pulling node2 ... Stderr:Pulling node2 ... Stderr:Pulling node2 ... pulling from altinityinfra/integr... Stderr:Pulling node2 ... pulling from altinityinfra/integr... Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... Stderr:Pulling node1 ... pulling from altinityinfra/integr... Stderr:Pulling node1 ... pulling from altinityinfra/integr... Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node2 ... status: image is up to date for a... Stderr:Pulling node2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... done Stderr:Pulling proxy2 ... done Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo2 ... status: image is up to date for a... Stderr:Pulling zoo2 ... status: image is up to date for a... Stderr:Pulling node2 ... done Stderr:Pulling node2 ... done Stderr:Pulling zoo2 ... done Stderr:Pulling zoo2 ... done Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node1 ... status: image is up to date for a... Stderr:Pulling node1 ... status: image is up to date for a... Stderr:Pulling node1 ... done Stderr:Pulling node1 ... done Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo3 ... status: image is up to date for a... Stderr:Pulling zoo3 ... status: image is up to date for a... Stderr:Pulling zoo3 ... done Stderr:Pulling zoo3 ... done Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo1 ... status: image is up to date for a... Stderr:Pulling zoo1 ... status: image is up to date for a... Stderr:Pulling resolver ... done Stderr:Pulling resolver ... done Stderr:Pulling zoo1 ... done Stderr:Pulling zoo1 ... done Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... done Stderr:Pulling proxy1 ... done Stderr:Pulling minio1 ... error Stderr:Pulling minio1 ... error Stderr: Stderr: Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Exitcode:1 Exitcode:1 Failed to start cluster: Failed to start cluster: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling zoo1 ... Pulling zoo3 ... Pulling minio1 ... Pulling node1 ... Pulling node2 ... Pulling node2 ... pulling from altinityinfra/integr... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling zoo2 ... pulling from altinityinfra/integr... Pulling node1 ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling node2 ... done Pulling zoo2 ... done Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling zoo3 ... pulling from altinityinfra/integr... Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling zoo1 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling resolver ... done Pulling zoo1 ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling zoo1 ... Pulling zoo3 ... Pulling minio1 ... Pulling node1 ... Pulling node2 ... Pulling node2 ... pulling from altinityinfra/integr... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling zoo2 ... pulling from altinityinfra/integr... Pulling node1 ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling node2 ... done Pulling zoo2 ... done Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling zoo3 ... pulling from altinityinfra/integr... Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling zoo1 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling resolver ... done Pulling zoo1 ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Traceback (most recent call last): File "/ClickHouse/tests/integration/helpers/cluster.py", line 2831, in start retry(log_function=logging_pulling_images)(run_and_check)( File "/ClickHouse/tests/integration/helpers/retry_decorator.py", line 28, in wrapper raise e File "/ClickHouse/tests/integration/helpers/retry_decorator.py", line 19, in wrapper func(*args, **kwargs) File "/ClickHouse/tests/integration/helpers/cluster.py", line 129, in run_and_check raise Exception( Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling zoo1 ... Pulling zoo3 ... Pulling minio1 ... Pulling node1 ... Pulling node2 ... Pulling node2 ... pulling from altinityinfra/integr... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling zoo2 ... pulling from altinityinfra/integr... Pulling node1 ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling node2 ... done Pulling zoo2 ... done Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling zoo3 ... pulling from altinityinfra/integr... Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling zoo1 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling resolver ... done Pulling zoo1 ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied None None docker-compose up was not called. Trying to export docker.log for running containers docker-compose up was not called. Trying to export docker.log for running containers Cleanup called Cleanup called Docker networks for project roottestreplicatedzerocopyprojectionmutation_gw7 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreplicatedzerocopyprojectionmutation_gw7 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestreplicatedzerocopyprojectionmutation_gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreplicatedzerocopyprojectionmutation_gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestreplicatedzerocopyprojectionmutation_gw7 are DRIVER VOLUME NAME Docker volumes for project roottestreplicatedzerocopyprojectionmutation_gw7 are DRIVER VOLUME NAME Command:docker container list --all --filter name='^/roottestreplicatedzerocopyprojectionmutation_gw7_.*_1$' --format '{{.ID}}:{{.Names}}' Command:docker container list --all --filter name='^/roottestreplicatedzerocopyprojectionmutation_gw7_.*_1$' --format '{{.ID}}:{{.Names}}' Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestreplicatedzerocopyprojectionmutation_gw7 No running containers for project: roottestreplicatedzerocopyprojectionmutation_gw7 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused volumes... Trying to prune unused volumes... Command:['docker volume ls | wc -l'] Command:['docker volume ls | wc -l'] Stdout:1 Stdout:1 docker-compose up was not called. Trying to export docker.log for running containers docker-compose up was not called. Trying to export docker.log for running containers Cleanup called Cleanup called Docker networks for project roottestreplicatedzerocopyprojectionmutation_gw7 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreplicatedzerocopyprojectionmutation_gw7 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestreplicatedzerocopyprojectionmutation_gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreplicatedzerocopyprojectionmutation_gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestreplicatedzerocopyprojectionmutation_gw7 are DRIVER VOLUME NAME Docker volumes for project roottestreplicatedzerocopyprojectionmutation_gw7 are DRIVER VOLUME NAME Command:docker container list --all --filter name='^/roottestreplicatedzerocopyprojectionmutation_gw7_.*_1$' --format '{{.ID}}:{{.Names}}' Command:docker container list --all --filter name='^/roottestreplicatedzerocopyprojectionmutation_gw7_.*_1$' --format '{{.ID}}:{{.Names}}' Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestreplicatedzerocopyprojectionmutation_gw7 No running containers for project: roottestreplicatedzerocopyprojectionmutation_gw7 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused volumes... Trying to prune unused volumes... Command:['docker volume ls | wc -l'] Command:['docker volume ls | wc -l'] Stdout:1 Stdout:1 ------------------------------ Captured log setup ------------------------------ 2026-09-30 17:43:14 [ 514 ] DEBUG : Command:['docker ps | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 17:43:14 [ 514 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-09-30 17:43:14 [ 514 ] DEBUG : No running containers (conftest.py:95, cleanup_environment) 2026-09-30 17:43:14 [ 514 ] DEBUG : Pruning Docker networks (conftest.py:97, cleanup_environment) 2026-09-30 17:43:14 [ 514 ] DEBUG : Command:['docker network prune --force'] (cluster.py:113, run_and_check) 2026-09-30 17:43:14 [ 514 ] DEBUG : Command:["sysctl net.ipv4.ip_local_port_range='55000 65535'"] (cluster.py:113, run_and_check) 2026-09-30 17:43:14 [ 514 ] DEBUG : Stdout:net.ipv4.ip_local_port_range = 55000 65535 (cluster.py:121, run_and_check) 2026-09-30 17:43:14 [ 514 ] DEBUG : ENV DOCKER_KERBEROS_KDC_TAG 9391ecdee8d7 (cluster.py:446, __init__) 2026-09-30 17:43:14 [ 514 ] DEBUG : ENV CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse (cluster.py:446, __init__) 2026-09-30 17:43:14 [ 514 ] DEBUG : ENV MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 (cluster.py:446, __init__) 2026-09-30 17:43:14 [ 514 ] DEBUG : ENV JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true (cluster.py:446, __init__) 2026-09-30 17:43:14 [ 514 ] DEBUG : ENV TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 (cluster.py:446, __init__) 2026-09-30 17:43:14 [ 514 ] DEBUG : ENV HOSTNAME 8a1c44ceac15 (cluster.py:446, __init__) 2026-09-30 17:43:14 [ 514 ] DEBUG : ENV SHLVL 0 (cluster.py:446, __init__) 2026-09-30 17:43:14 [ 514 ] DEBUG : ENV HOME /root (cluster.py:446, __init__) 2026-09-30 17:43:14 [ 514 ] DEBUG : ENV OLDPWD / (cluster.py:446, __init__) 2026-09-30 17:43:14 [ 514 ] DEBUG : ENV DOCKER_HELPER_TAG 2cffe1eae894 (cluster.py:446, __init__) 2026-09-30 17:43:14 [ 514 ] DEBUG : ENV PYTHONUNBUFFERED 1 (cluster.py:446, __init__) 2026-09-30 17:43:14 [ 514 ] DEBUG : ENV DOCKER_PYTHON_BOTTLE_TAG caad4729259e (cluster.py:446, __init__) 2026-09-30 17:43:14 [ 514 ] DEBUG : ENV UBSAN_OPTIONS print_stacktrace=1 (cluster.py:446, __init__) 2026-09-30 17:43:14 [ 514 ] DEBUG : ENV PYTEST_ADDOPTS --dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-10-100000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-1000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-10000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-100000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-1000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-10000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-100000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-1000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-10000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-100000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-key-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-key-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-sipHash64(key)-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-sipHash64(key)-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-key-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-key-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-sipHash64(key)-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-sipHash64(key)-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-key-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-key-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-sipHash64(key)-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-sipHash64(key)-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-key-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-key-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-sipHash64(key)-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-sipHash64(key)-1]' test_relative_filepath/test.py::test_filepath test_reload_clusters_config/test.py::test_add_cluster test_reload_clusters_config/test.py::test_delete_cluster test_reload_clusters_config/test.py::test_simple_reload test_reload_clusters_config/test.py::test_update_one_cluster test_replica_can_become_leader/test.py::test_can_become_leader test_replica_is_active/test.py::test_replica_is_active test_replicated_merge_tree_thread_schedule_timeouts/test.py::test_query_exception_on_thread_pool_full test_replicated_zero_copy_projection_mutation/test.py::test_all_projection_files_are_dropped_when_part_is_dropped test_replicated_zero_copy_projection_mutation/test.py::test_hardlinks_preserved_when_projection_dropped test_restore_replica/test.py::test_restore_replica_alive_replicas test_restore_replica/test.py::test_restore_replica_invalid_tables test_restore_replica/test.py::test_restore_replica_parallel test_restore_replica/test.py::test_restore_replica_sequential test_s3_storage_class/test.py::test_s3_storage_class_right 'test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[None-zero_copy_lock_zk_fail_after_op]' 'test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[None-zero_copy_lock_zk_fail_before_op]' 'test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_after_op-zero_copy_lock_zk_fail_after_op]' 'test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_after_op-zero_copy_lock_zk_fail_before_op]' 'test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_before_op-zero_copy_lock_zk_fail_after_op]' 'test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_before_op-zero_copy_lock_zk_fail_before_op]' test_s3_zero_copy_replication/test.py::test_s3_zero_copy_concurrent_merge test_s3_zero_copy_replication/test.py::test_s3_zero_copy_drop_detached_alter test_s3_zero_copy_replication/test.py::test_s3_zero_copy_drop_detached_system test_s3_zero_copy_replication/test.py::test_s3_zero_copy_keeps_data_after_mutation 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_replication[s3]' test_s3_zero_copy_replication/test.py::test_s3_zero_copy_unfreeze_alter test_s3_zero_copy_replication/test.py::test_s3_zero_copy_unfreeze_system 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_delete[False-10]' 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_delete[True-3]' 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered-False-10]' 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered-True-3]' 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered_copy-False-10]' 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered_copy-True-3]' test_scheduler/test.py::test_merge_workload test_scheduler/test.py::test_merge_workload_change test_scheduler/test.py::test_merge_workload_override test_scheduler/test.py::test_mutate_workload test_scheduler/test.py::test_mutation_workload_change test_scheduler/test.py::test_mutation_workload_override test_scheduler/test.py::test_s3_disk test_secure_socket/test.py::test test_send_crash_reports/test.py::test_send_segfault test_server_initialization/test.py::test_partially_dropped_tables test_server_initialization/test.py::test_sophisticated_default test_server_start_and_ip_conversions/test.py::test_restart_success_ipv4 test_server_start_and_ip_conversions/test.py::test_restart_success_ipv6 test_storage_azure_blob_storage/test.py::test_azure_glob_scheherazade test_storage_azure_blob_storage/test.py::test_create_new_files_on_insert test_storage_azure_blob_storage/test.py::test_create_table_account_string test_storage_azure_blob_storage/test.py::test_create_table_connection_string test_storage_azure_blob_storage/test.py::test_filter_using_file test_storage_azure_blob_storage/test.py::test_filtering_by_file_or_path test_storage_azure_blob_storage/test.py::test_format_detection test_storage_azure_blob_storage/test.py::test_function_signatures test_storage_azure_blob_storage/test.py::test_hive_partitioning_with_all_parameters test_storage_azure_blob_storage/test.py::test_hive_partitioning_with_one_parameter test_storage_azure_blob_storage/test.py::test_hive_partitioning_without_setting test_storage_azure_blob_storage/test.py::test_insert_create_new_file test_storage_azure_blob_storage/test.py::test_insert_with_path_with_globs test_storage_azure_blob_storage/test.py::test_overwrite test_storage_azure_blob_storage/test.py::test_parallel_read test_storage_azure_blob_storage/test.py::test_partition_by test_storage_azure_blob_storage/test.py::test_partition_by_const_column test_storage_azure_blob_storage/test.py::test_partition_by_string_column -vvv (cluster.py:446, __init__) 2026-09-30 17:43:14 [ 514 ] DEBUG : ENV CLICKHOUSE_LIBRARY_BRIDGE_BINARY_PATH /clickhouse-library-bridge (cluster.py:446, __init__) 2026-09-30 17:43:14 [ 514 ] DEBUG : ENV COMPOSE_HTTP_TIMEOUT 600 (cluster.py:446, __init__) 2026-09-30 17:43:14 [ 514 ] DEBUG : ENV DOCKER_MYSQL_PHP_CLIENT_TAG 88be89c1e3b6 (cluster.py:446, __init__) 2026-09-30 17:43:14 [ 514 ] DEBUG : ENV DOCKER_DOTNET_CLIENT_TAG 11de0b29a15d (cluster.py:446, __init__) 2026-09-30 17:43:14 [ 514 ] DEBUG : ENV CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse (cluster.py:446, __init__) 2026-09-30 17:43:14 [ 514 ] DEBUG : ENV DOCKER_MYSQL_JS_CLIENT_TAG 41ba7c2ec2a1 (cluster.py:446, __init__) 2026-09-30 17:43:14 [ 514 ] DEBUG : ENV PATH /spark-3.3.2-bin-hadoop3/bin:/opt/gdb/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin (cluster.py:446, __init__) 2026-09-30 17:43:14 [ 514 ] DEBUG : ENV DOCKER_KERBERIZED_HADOOP_TAG latest (cluster.py:446, __init__) 2026-09-30 17:43:14 [ 514 ] DEBUG : ENV DOCKER_CHANNEL stable (cluster.py:446, __init__) 2026-09-30 17:43:14 [ 514 ] DEBUG : ENV DOCKER_CLIENT_TIMEOUT 300 (cluster.py:446, __init__) 2026-09-30 17:43:14 [ 514 ] DEBUG : ENV DOCKER_POSTGRESQL_JAVA_CLIENT_TAG a4eff5c7f4d6 (cluster.py:446, __init__) 2026-09-30 17:43:14 [ 514 ] DEBUG : ENV DOCKER_NGINX_DAV_TAG b55ac9cd7519 (cluster.py:446, __init__) 2026-09-30 17:43:14 [ 514 ] DEBUG : ENV DOCKER_MYSQL_GOLANG_CLIENT_TAG 9bec2a638e6e (cluster.py:446, __init__) 2026-09-30 17:43:14 [ 514 ] DEBUG : ENV PWD /ClickHouse/tests/integration (cluster.py:446, __init__) 2026-09-30 17:43:14 [ 514 ] DEBUG : ENV DOCKER_MYSQL_JAVA_CLIENT_TAG 766bff31cfe4 (cluster.py:446, __init__) 2026-09-30 17:43:14 [ 514 ] DEBUG : ENV CLICKHOUSE_ODBC_BRIDGE_BINARY_PATH /clickhouse-odbc-bridge (cluster.py:446, __init__) 2026-09-30 17:43:14 [ 514 ] DEBUG : ENV CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config (cluster.py:446, __init__) 2026-09-30 17:43:14 [ 514 ] DEBUG : ENV TZ Etc/UTC (cluster.py:446, __init__) 2026-09-30 17:43:14 [ 514 ] DEBUG : ENV JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java (cluster.py:446, __init__) 2026-09-30 17:43:14 [ 514 ] DEBUG : ENV DOCKER_BASE_TAG b74d853ebe76 (cluster.py:446, __init__) 2026-09-30 17:43:14 [ 514 ] DEBUG : ENV SPARK_HOME /spark-3.3.2-bin-hadoop3 (cluster.py:446, __init__) 2026-09-30 17:43:14 [ 514 ] DEBUG : ENV LC_CTYPE C.UTF-8 (cluster.py:446, __init__) 2026-09-30 17:43:14 [ 514 ] DEBUG : ENV INTEGRATION_TESTS_RUN_ID 0 (cluster.py:446, __init__) 2026-09-30 17:43:14 [ 514 ] DEBUG : ENV WORKER_FREE_PORTS 30350 30351 30352 30353 30354 30355 30356 30357 30358 30359 30360 30361 30362 30363 30364 30365 30366 30367 30368 30369 30370 30371 30372 30373 30374 30375 30376 30377 30378 30379 30380 30381 30382 30383 30384 30385 30386 30387 30388 30389 30390 30391 30392 30393 30394 30395 30396 30397 30398 30399 (cluster.py:446, __init__) 2026-09-30 17:43:14 [ 514 ] DEBUG : ENV PYTEST_XDIST_TESTRUNUID 203ac44cc76f42ab958527e478875f97 (cluster.py:446, __init__) 2026-09-30 17:43:14 [ 514 ] DEBUG : ENV PYTEST_XDIST_WORKER gw7 (cluster.py:446, __init__) 2026-09-30 17:43:14 [ 514 ] DEBUG : ENV PYTEST_XDIST_WORKER_COUNT 10 (cluster.py:446, __init__) 2026-09-30 17:43:14 [ 514 ] DEBUG : ENV PYTEST_CURRENT_TEST test_replicated_zero_copy_projection_mutation/test.py::test_all_projection_files_are_dropped_when_part_is_dropped (setup) (cluster.py:446, __init__) 2026-09-30 17:43:14 [ 514 ] DEBUG : CLUSTER INIT base_config_dir:/clickhouse-config (cluster.py:766, __init__) 2026-09-30 17:43:14 [ 514 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1787, add_instance) 2026-09-30 17:43:14 [ 514 ] DEBUG : Setup Keeper (cluster.py:1059, setup_keeper_cmd) 2026-09-30 17:43:14 [ 514 ] DEBUG : Cluster name: project_name:roottestreplicatedzerocopyprojectionmutation_gw7. Added instance name:node1 tag:b74d853ebe76 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ (cluster.py:2081, add_instance) 2026-09-30 17:43:14 [ 514 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1787, add_instance) 2026-09-30 17:43:14 [ 514 ] DEBUG : Cluster name: project_name:roottestreplicatedzerocopyprojectionmutation_gw7. Added instance name:node2 tag:b74d853ebe76 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ (cluster.py:2081, add_instance) 2026-09-30 17:43:14 [ 514 ] INFO : Running tests in /ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/test.py (cluster.py:2790, start) 2026-09-30 17:43:14 [ 514 ] DEBUG : Cluster start called. is_up=False (cluster.py:2797, start) 2026-09-30 17:43:14 [ 514 ] DEBUG : Docker networks for project roottestreplicatedzerocopyprojectionmutation_gw7 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 17:43:14 [ 514 ] DEBUG : Docker containers for project roottestreplicatedzerocopyprojectionmutation_gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 17:43:14 [ 514 ] DEBUG : Docker volumes for project roottestreplicatedzerocopyprojectionmutation_gw7 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 17:43:14 [ 514 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 17:43:14 [ 514 ] DEBUG : Docker networks for project roottestreplicatedzerocopyprojectionmutation_gw7 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 17:43:14 [ 514 ] DEBUG : Docker containers for project roottestreplicatedzerocopyprojectionmutation_gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 17:43:14 [ 514 ] DEBUG : Docker volumes for project roottestreplicatedzerocopyprojectionmutation_gw7 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 17:43:14 [ 514 ] DEBUG : Command:docker container list --all --filter name='^/roottestreplicatedzerocopyprojectionmutation_gw7_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 17:43:14 [ 514 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 17:43:14 [ 514 ] DEBUG : No running containers for project: roottestreplicatedzerocopyprojectionmutation_gw7 (cluster.py:904, cleanup) 2026-09-30 17:43:14 [ 514 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 17:43:14 [ 514 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 17:43:14 [ 514 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 17:43:14 [ 514 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-09-30 17:43:14 [ 514 ] DEBUG : Setup directory for instance: node1 (cluster.py:2810, start) 2026-09-30 17:43:14 [ 514 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4538, create_dir) 2026-09-30 17:43:14 [ 514 ] DEBUG : Create directory for common tests configuration (cluster.py:4543, create_dir) 2026-09-30 17:43:14 [ 514 ] DEBUG : Copy common configuration from helpers (cluster.py:4563, create_dir) 2026-09-30 17:43:14 [ 514 ] DEBUG : Generate and write macros file (cluster.py:4606, create_dir) 2026-09-30 17:43:14 [ 514 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/configs/config.d/storage_conf.xml'] to /ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/configs/config.d (cluster.py:4636, create_dir) 2026-09-30 17:43:14 [ 514 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/database (cluster.py:4653, create_dir) 2026-09-30 17:43:14 [ 514 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/logs (cluster.py:4664, create_dir) 2026-09-30 17:43:14 [ 514 ] DEBUG : Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon; coproc tail -f /dev/null; wait $$!" (cluster.py:4750, create_dir) 2026-09-30 17:43:14 [ 514 ] DEBUG : Setup directory for instance: node2 (cluster.py:2810, start) 2026-09-30 17:43:14 [ 514 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4538, create_dir) 2026-09-30 17:43:14 [ 514 ] DEBUG : Create directory for common tests configuration (cluster.py:4543, create_dir) 2026-09-30 17:43:14 [ 514 ] DEBUG : Copy common configuration from helpers (cluster.py:4563, create_dir) 2026-09-30 17:43:14 [ 514 ] DEBUG : Generate and write macros file (cluster.py:4606, create_dir) 2026-09-30 17:43:14 [ 514 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/configs/config.d/storage_conf.xml'] to /ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/configs/config.d (cluster.py:4636, create_dir) 2026-09-30 17:43:14 [ 514 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/database (cluster.py:4653, create_dir) 2026-09-30 17:43:14 [ 514 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/logs (cluster.py:4664, create_dir) 2026-09-30 17:43:14 [ 514 ] DEBUG : Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon; coproc tail -f /dev/null; wait $$!" (cluster.py:4750, create_dir) 2026-09-30 17:43:14 [ 514 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:b74d853ebe76', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/keeper3/coordination', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/minio/certs/public.crt'} stored in /ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env (cluster.py:86, _create_env_file) 2026-09-30 17:43:14 [ 514 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-09-30 17:43:14 [ 514 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-09-30 17:43:14 [ 514 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-09-30 17:43:14 [ 514 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-09-30 17:43:14 [ 514 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 825 (connectionpool.py:547, _make_request) 2026-09-30 17:43:14 [ 514 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 17:45:01 [ 514 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-09-30 17:45:01 [ 514 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-09-30 17:45:01 [ 514 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 17:45:01 [ 514 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-09-30 17:45:01 [ 514 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 17:45:01 [ 514 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 17:45:01 [ 514 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 17:45:01 [ 514 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-09-30 17:45:01 [ 514 ] DEBUG : Stderr:Pulling node2 ... (cluster.py:123, run_and_check) 2026-09-30 17:45:01 [ 514 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 17:45:01 [ 514 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 17:45:01 [ 514 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 17:45:01 [ 514 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 17:45:01 [ 514 ] DEBUG : Stderr:Pulling node2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 17:45:01 [ 514 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 17:45:01 [ 514 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:45:01 [ 514 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 17:45:01 [ 514 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:45:01 [ 514 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-09-30 17:45:01 [ 514 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-09-30 17:45:01 [ 514 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 17:45:01 [ 514 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:45:01 [ 514 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 17:45:01 [ 514 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:45:01 [ 514 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 17:45:01 [ 514 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-09-30 17:45:01 [ 514 ] DEBUG : Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 17:45:01 [ 514 ] DEBUG : Stderr:Pulling node2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:45:01 [ 514 ] DEBUG : Stderr:Pulling node2 ... done (cluster.py:123, run_and_check) 2026-09-30 17:45:01 [ 514 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 17:45:01 [ 514 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 17:45:01 [ 514 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 17:45:01 [ 514 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 17:45:01 [ 514 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:45:01 [ 514 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 17:45:01 [ 514 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:45:01 [ 514 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 17:45:01 [ 514 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-09-30 17:45:01 [ 514 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 17:45:01 [ 514 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:45:01 [ 514 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 17:45:01 [ 514 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 17:45:01 [ 514 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 17:45:01 [ 514 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 17:45:01 [ 514 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 17:45:01 [ 514 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 17:45:01 [ 514 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo1 ... Pulling zoo2 ... Pulling proxy2 ... Pulling zoo3 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node1 ... Pulling node2 ... Pulling node1 ... pulling from altinityinfra/integr... Pulling zoo2 ... pulling from altinityinfra/integr... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling node2 ... pulling from altinityinfra/integr... Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling node1 ... done Pulling zoo2 ... done Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling zoo1 ... done Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling node2 ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling zoo3 ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling proxy2 ... done Pulling zoo3 ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 17:45:03 [ 514 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 17:46:36 [ 514 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 514 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 514 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 514 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 514 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 514 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 514 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 514 ] DEBUG : Stderr:Pulling node2 ... (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 514 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 514 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 514 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 514 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 514 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 514 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 514 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 514 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 514 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 514 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 514 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 514 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 514 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 514 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 514 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 514 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 514 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 514 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 514 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 514 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 514 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 514 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 514 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 514 ] DEBUG : Stderr:Pulling node2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 514 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 514 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 514 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 514 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 514 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 514 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 514 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 514 ] DEBUG : Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 514 ] DEBUG : Stderr:Pulling node2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 514 ] DEBUG : Stderr:Pulling node2 ... done (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 514 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 514 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 514 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 17:46:36 [ 514 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 17:46:36 [ 514 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling zoo2 ... Pulling zoo3 ... Pulling zoo1 ... Pulling resolver ... Pulling minio1 ... Pulling node2 ... Pulling node1 ... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling node1 ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling minio1 ... error Pulling zoo2 ... pulling from altinityinfra/integr... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling zoo1 ... pulling from altinityinfra/integr... Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling node2 ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling proxy2 ... done Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling node2 ... done ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 17:46:39 [ 514 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 17:48:23 [ 514 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 514 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 514 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 514 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 514 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 514 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 514 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 514 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 514 ] DEBUG : Stderr:Pulling node2 ... (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 514 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 514 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 514 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 514 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 514 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 514 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 514 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 514 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 514 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 514 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 514 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 514 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 514 ] DEBUG : Stderr:Pulling node2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 514 ] DEBUG : Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 514 ] DEBUG : Stderr:Pulling node2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 514 ] DEBUG : Stderr:Pulling node2 ... done (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 514 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 514 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 514 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 514 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 514 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 514 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 514 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 514 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 514 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 514 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 514 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 514 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 514 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 514 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 514 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 514 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 514 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 514 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 514 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 514 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 17:48:23 [ 514 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 17:48:23 [ 514 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling zoo1 ... Pulling zoo3 ... Pulling zoo2 ... Pulling node1 ... Pulling node2 ... Pulling node1 ... pulling from altinityinfra/integr... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling zoo2 ... pulling from altinityinfra/integr... Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo2 ... done Pulling zoo1 ... done Pulling node2 ... pulling from altinityinfra/integr... Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling node2 ... done Pulling minio1 ... error Pulling zoo3 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling resolver ... done Pulling proxy2 ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 17:48:27 [ 514 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 17:50:12 [ 514 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-09-30 17:50:12 [ 514 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 17:50:12 [ 514 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 17:50:12 [ 514 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 17:50:12 [ 514 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-09-30 17:50:12 [ 514 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-09-30 17:50:12 [ 514 ] DEBUG : Stderr:Pulling node2 ... (cluster.py:123, run_and_check) 2026-09-30 17:50:12 [ 514 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-09-30 17:50:12 [ 514 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 17:50:12 [ 514 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 17:50:12 [ 514 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 17:50:12 [ 514 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 17:50:12 [ 514 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 17:50:12 [ 514 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:50:12 [ 514 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-09-30 17:50:12 [ 514 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 17:50:12 [ 514 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:50:12 [ 514 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-09-30 17:50:12 [ 514 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 17:50:12 [ 514 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 17:50:12 [ 514 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:50:12 [ 514 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 17:50:12 [ 514 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 17:50:12 [ 514 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 17:50:12 [ 514 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:50:12 [ 514 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 17:50:12 [ 514 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 17:50:12 [ 514 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:50:12 [ 514 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 17:50:12 [ 514 ] DEBUG : Stderr:Pulling node2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 17:50:12 [ 514 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 17:50:12 [ 514 ] DEBUG : Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 17:50:12 [ 514 ] DEBUG : Stderr:Pulling node2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:50:12 [ 514 ] DEBUG : Stderr:Pulling node2 ... done (cluster.py:123, run_and_check) 2026-09-30 17:50:12 [ 514 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 17:50:12 [ 514 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:50:12 [ 514 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-09-30 17:50:12 [ 514 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 17:50:12 [ 514 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 17:50:12 [ 514 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:50:12 [ 514 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-09-30 17:50:12 [ 514 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 17:50:12 [ 514 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 17:50:12 [ 514 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 17:50:12 [ 514 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 17:50:12 [ 514 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 17:50:12 [ 514 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo1 ... Pulling proxy1 ... Pulling proxy2 ... Pulling minio1 ... Pulling zoo3 ... Pulling zoo2 ... Pulling node2 ... Pulling node1 ... Pulling resolver ... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling zoo3 ... pulling from altinityinfra/integr... Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling node2 ... pulling from altinityinfra/integr... Pulling zoo2 ... pulling from altinityinfra/integr... Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling node2 ... done Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling node1 ... pulling from altinityinfra/integr... Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 17:50:16 [ 514 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 17:51:51 [ 514 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-09-30 17:51:51 [ 514 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 17:51:51 [ 514 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 17:51:51 [ 514 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 17:51:51 [ 514 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-09-30 17:51:51 [ 514 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-09-30 17:51:51 [ 514 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 17:51:51 [ 514 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-09-30 17:51:51 [ 514 ] DEBUG : Stderr:Pulling node2 ... (cluster.py:123, run_and_check) 2026-09-30 17:51:51 [ 514 ] DEBUG : Stderr:Pulling node2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 17:51:51 [ 514 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 17:51:51 [ 514 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 17:51:51 [ 514 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 17:51:51 [ 514 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 17:51:51 [ 514 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:51:51 [ 514 ] DEBUG : Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 17:51:51 [ 514 ] DEBUG : Stderr:Pulling node2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:51:51 [ 514 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 17:51:51 [ 514 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 17:51:51 [ 514 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:51:51 [ 514 ] DEBUG : Stderr:Pulling node2 ... done (cluster.py:123, run_and_check) 2026-09-30 17:51:51 [ 514 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-09-30 17:51:51 [ 514 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 17:51:51 [ 514 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:51:51 [ 514 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-09-30 17:51:51 [ 514 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 17:51:51 [ 514 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 17:51:51 [ 514 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:51:51 [ 514 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-09-30 17:51:51 [ 514 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 17:51:51 [ 514 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 17:51:51 [ 514 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 17:51:51 [ 514 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 17:51:51 [ 514 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:51:51 [ 514 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 17:51:51 [ 514 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:51:51 [ 514 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 17:51:51 [ 514 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-09-30 17:51:51 [ 514 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 17:51:51 [ 514 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 17:51:51 [ 514 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 17:51:51 [ 514 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 17:51:51 [ 514 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 17:51:51 [ 514 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 17:51:51 [ 514 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 17:51:51 [ 514 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 17:51:51 [ 514 ] DEBUG : Failed to start cluster: (cluster.py:3178, start) 2026-09-30 17:51:51 [ 514 ] DEBUG : Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling zoo1 ... Pulling zoo3 ... Pulling minio1 ... Pulling node1 ... Pulling node2 ... Pulling node2 ... pulling from altinityinfra/integr... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling zoo2 ... pulling from altinityinfra/integr... Pulling node1 ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling node2 ... done Pulling zoo2 ... done Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling zoo3 ... pulling from altinityinfra/integr... Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling zoo1 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling resolver ... done Pulling zoo1 ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:3179, start) 2026-09-30 17:51:51 [ 514 ] DEBUG : None (cluster.py:3180, start) 2026-09-30 17:51:51 [ 514 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3246, shutdown) 2026-09-30 17:51:51 [ 514 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 17:51:51 [ 514 ] DEBUG : Docker networks for project roottestreplicatedzerocopyprojectionmutation_gw7 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 17:51:51 [ 514 ] DEBUG : Docker containers for project roottestreplicatedzerocopyprojectionmutation_gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 17:51:51 [ 514 ] DEBUG : Docker volumes for project roottestreplicatedzerocopyprojectionmutation_gw7 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 17:51:51 [ 514 ] DEBUG : Command:docker container list --all --filter name='^/roottestreplicatedzerocopyprojectionmutation_gw7_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 17:51:51 [ 514 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 17:51:51 [ 514 ] DEBUG : No running containers for project: roottestreplicatedzerocopyprojectionmutation_gw7 (cluster.py:904, cleanup) 2026-09-30 17:51:51 [ 514 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 17:51:51 [ 514 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 17:51:51 [ 514 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 17:51:51 [ 514 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-09-30 17:51:51 [ 514 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3246, shutdown) 2026-09-30 17:51:51 [ 514 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 17:51:51 [ 514 ] DEBUG : Docker networks for project roottestreplicatedzerocopyprojectionmutation_gw7 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 17:51:51 [ 514 ] DEBUG : Docker containers for project roottestreplicatedzerocopyprojectionmutation_gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 17:51:51 [ 514 ] DEBUG : Docker volumes for project roottestreplicatedzerocopyprojectionmutation_gw7 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 17:51:51 [ 514 ] DEBUG : Command:docker container list --all --filter name='^/roottestreplicatedzerocopyprojectionmutation_gw7_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 17:51:51 [ 514 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 17:51:51 [ 514 ] DEBUG : No running containers for project: roottestreplicatedzerocopyprojectionmutation_gw7 (cluster.py:904, cleanup) 2026-09-30 17:51:51 [ 514 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 17:51:51 [ 514 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 17:51:51 [ 514 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 17:51:51 [ 514 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) ______ ERROR at setup of test_hardlinks_preserved_when_projection_dropped ______ [gw7] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) kwargs = args_to_dict( main_configs=[ "configs/config.d/storage_conf.xml", ], user_configs=[ "configs/config.d/users.xml", ], with_minio=True, with_zookeeper=True, stay_alive=True, ) cluster.add_instance("node1", **kwargs) cluster.add_instance("node2", **kwargs) > cluster.start() test_replicated_zero_copy_projection_mutation/test.py:37: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling zoo1 ... E Pulling zoo3 ... E Pulling minio1 ... E Pulling node1 ... E Pulling node2 ... E Pulling node2 ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling node1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling node2 ... digest: sha256:2ea9da862c215fd684... E Pulling node2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling node2 ... done E Pulling zoo2 ... done E Pulling node1 ... digest: sha256:2ea9da862c215fd684... E Pulling node1 ... status: image is up to date for a... E Pulling node1 ... done E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling resolver ... done E Pulling zoo1 ... done E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception =============================== warnings summary =============================== test_parallel_replicas_all_marks_read/test.py: 19 warnings /usr/lib/python3.10/random.py:370: DeprecationWarning: non-integer arguments to randrange() have been deprecated since Python 3.10 and will be removed in a subsequent version return self.randrange(a, b+1) test_restore_replica/test.py::test_restore_replica_sequential /usr/local/lib/python3.10/dist-packages/_pytest/threadexception.py:73: PytestUnhandledThreadExceptionWarning: Exception in thread Thread-12 (zk_loop) Traceback (most recent call last): File "/usr/lib/python3.10/threading.py", line 1016, in _bootstrap_inner self.run() File "/usr/lib/python3.10/threading.py", line 953, in run self._target(*self._args, **self._kwargs) File "/usr/local/lib/python3.10/dist-packages/kazoo/protocol/connection.py", line 512, in zk_loop if retry(self._connect_loop, retry) is STOP_CONNECTING: File "/usr/local/lib/python3.10/dist-packages/kazoo/retry.py", line 126, in __call__ return func(*args, **kwargs) File "/usr/local/lib/python3.10/dist-packages/kazoo/protocol/connection.py", line 552, in _connect_loop status = self._connect_attempt(host, hostip, port, retry) File "/usr/local/lib/python3.10/dist-packages/kazoo/protocol/connection.py", line 602, in _connect_attempt response = self._read_socket(read_timeout) File "/usr/local/lib/python3.10/dist-packages/kazoo/protocol/connection.py", line 453, in _read_socket return self._read_response(header, buffer, offset) File "/usr/local/lib/python3.10/dist-packages/kazoo/protocol/connection.py", line 376, in _read_response request, async_object, xid = client._pending.popleft() IndexError: pop from an empty deque warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg)) test_storage_azure_blob_storage/test.py: 1023 warnings /usr/local/lib/python3.10/dist-packages/azure/storage/blob/_container_client.py:1781: DeprecationWarning: The use of a 'BlobProperties' instance for param blob is deprecated. Please use 'BlobProperties.name' or any other str input type instead. warnings.warn( -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html ============================== slowest durations =============================== 517.67s setup test_replicated_zero_copy_projection_mutation/test.py::test_all_projection_files_are_dropped_when_part_is_dropped 507.06s setup test_s3_zero_copy_replication/test.py::test_s3_zero_copy_replication[s3] 298.71s setup test_scheduler/test.py::test_merge_workload 281.48s setup test_s3_storage_class/test.py::test_s3_storage_class_right 105.62s setup test_server_initialization/test.py::test_partially_dropped_tables 105.45s setup test_restore_replica/test.py::test_restore_replica_alive_replicas 104.60s setup test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-10-100000-SELECT sum(cityHash64(*)) FROM {table_name}] 100.49s setup test_replica_is_active/test.py::test_replica_is_active 92.42s setup test_replica_can_become_leader/test.py::test_can_become_leader 85.52s call test_storage_azure_blob_storage/test.py::test_azure_glob_scheherazade 62.33s setup test_reload_clusters_config/test.py::test_add_cluster 61.66s setup test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-key-0] 56.99s setup test_storage_azure_blob_storage/test.py::test_azure_glob_scheherazade 54.89s setup test_server_start_and_ip_conversions/test.py::test_restart_success_ipv4 54.21s setup test_secure_socket/test.py::test 54.20s setup test_relative_filepath/test.py::test_filepath 52.20s setup test_replicated_merge_tree_thread_schedule_timeouts/test.py::test_query_exception_on_thread_pool_full 48.05s setup test_send_crash_reports/test.py::test_send_segfault 16.91s call test_secure_socket/test.py::test 12.30s teardown test_restore_replica/test.py::test_restore_replica_sequential 9.46s teardown test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-sipHash64(key)-1] 9.23s teardown test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-100000-SELECT sum(cityHash64(*)) FROM {table_name}] 8.95s setup test_storage_azure_blob_storage/test.py::test_create_new_files_on_insert 7.97s teardown test_secure_socket/test.py::test 6.92s teardown test_send_crash_reports/test.py::test_send_segfault 6.04s teardown test_replica_can_become_leader/test.py::test_can_become_leader 5.64s teardown test_replica_is_active/test.py::test_replica_is_active 5.60s teardown test_storage_azure_blob_storage/test.py::test_partition_by_string_column 5.60s call test_server_start_and_ip_conversions/test.py::test_restart_success_ipv6 5.53s teardown test_replicated_merge_tree_thread_schedule_timeouts/test.py::test_query_exception_on_thread_pool_full 5.41s call test_server_start_and_ip_conversions/test.py::test_restart_success_ipv4 5.19s call test_replica_is_active/test.py::test_replica_is_active 5.06s teardown test_relative_filepath/test.py::test_filepath 4.87s teardown test_reload_clusters_config/test.py::test_update_one_cluster 4.62s call test_restore_replica/test.py::test_restore_replica_sequential 4.32s call test_restore_replica/test.py::test_restore_replica_parallel 4.10s call test_restore_replica/test.py::test_restore_replica_alive_replicas 3.71s call test_replicated_merge_tree_thread_schedule_timeouts/test.py::test_query_exception_on_thread_pool_full 3.17s call test_storage_azure_blob_storage/test.py::test_format_detection 2.74s teardown test_server_start_and_ip_conversions/test.py::test_restart_success_ipv6 2.65s call test_send_crash_reports/test.py::test_send_segfault 2.59s teardown test_server_initialization/test.py::test_sophisticated_default 2.20s call test_reload_clusters_config/test.py::test_add_cluster 2.03s call test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-key-0] 2.02s call test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] 1.95s call test_reload_clusters_config/test.py::test_delete_cluster 1.82s call test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-sipHash64(key)-0] 1.82s call test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-key-0] 1.79s call test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-sipHash64(key)-0] 1.75s call test_reload_clusters_config/test.py::test_update_one_cluster 1.74s call test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-key-1] 1.72s call test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] 1.72s call test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-sipHash64(key)-1] 1.72s call test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-key-1] 1.72s call test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] 1.70s call test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-sipHash64(key)-0] 1.69s call test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-sipHash64(key)-0] 1.69s call test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-key-0] 1.68s call test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-sipHash64(key)-1] 1.67s call test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-key-1] 1.67s call test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] 1.65s call test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-100000-SELECT sum(cityHash64(*)) FROM {table_name}] 1.64s call test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-sipHash64(key)-1] 1.63s call test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-sipHash64(key)-1] 1.59s call test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-key-0] 1.57s call test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] 1.52s call test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-100000-SELECT sum(cityHash64(*)) FROM {table_name}] 1.47s call test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-key-1] 1.46s call test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] 1.44s call test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] 1.41s call test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] 1.41s call test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] 1.41s call test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-10000-SELECT sum(cityHash64(*)) FROM {table_name}] 1.35s call test_storage_azure_blob_storage/test.py::test_parallel_read 1.32s call test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-10-100000-SELECT sum(cityHash64(*)) FROM {table_name}] 1.27s call test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-10000-SELECT sum(cityHash64(*)) FROM {table_name}] 1.25s call test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-1000-SELECT sum(cityHash64(*)) FROM {table_name}] 1.23s call test_storage_azure_blob_storage/test.py::test_function_signatures 1.20s call test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-100000-SELECT sum(cityHash64(*)) FROM {table_name}] 1.16s call test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-1000-SELECT sum(cityHash64(*)) FROM {table_name}] 1.15s call test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-10000-SELECT sum(cityHash64(*)) FROM {table_name}] 1.10s call test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-1000-SELECT sum(cityHash64(*)) FROM {table_name}] 0.80s call test_storage_azure_blob_storage/test.py::test_filtering_by_file_or_path 0.79s call test_reload_clusters_config/test.py::test_simple_reload 0.72s call test_storage_azure_blob_storage/test.py::test_create_new_files_on_insert 0.61s call test_storage_azure_blob_storage/test.py::test_overwrite 0.41s call test_relative_filepath/test.py::test_filepath 0.35s call test_storage_azure_blob_storage/test.py::test_insert_create_new_file 0.31s call test_storage_azure_blob_storage/test.py::test_partition_by_const_column 0.30s call test_storage_azure_blob_storage/test.py::test_hive_partitioning_with_one_parameter 0.30s call test_storage_azure_blob_storage/test.py::test_insert_with_path_with_globs 0.27s call test_storage_azure_blob_storage/test.py::test_partition_by_string_column 0.27s call test_storage_azure_blob_storage/test.py::test_partition_by 0.25s call test_server_initialization/test.py::test_partially_dropped_tables 0.25s call test_restore_replica/test.py::test_restore_replica_invalid_tables 0.23s call test_storage_azure_blob_storage/test.py::test_filter_using_file 0.18s call test_storage_azure_blob_storage/test.py::test_hive_partitioning_with_all_parameters 0.18s call test_storage_azure_blob_storage/test.py::test_hive_partitioning_without_setting 0.13s call test_storage_azure_blob_storage/test.py::test_create_table_connection_string 0.13s call test_replica_can_become_leader/test.py::test_can_become_leader 0.13s call test_storage_azure_blob_storage/test.py::test_create_table_account_string 0.13s call test_server_initialization/test.py::test_sophisticated_default 0.06s setup test_storage_azure_blob_storage/test.py::test_format_detection 0.05s setup test_storage_azure_blob_storage/test.py::test_filtering_by_file_or_path 0.04s setup test_storage_azure_blob_storage/test.py::test_hive_partitioning_with_all_parameters 0.04s setup test_storage_azure_blob_storage/test.py::test_hive_partitioning_with_one_parameter 0.04s setup test_storage_azure_blob_storage/test.py::test_insert_create_new_file 0.04s setup test_storage_azure_blob_storage/test.py::test_parallel_read 0.04s setup test_storage_azure_blob_storage/test.py::test_function_signatures 0.03s setup test_storage_azure_blob_storage/test.py::test_partition_by_const_column 0.03s setup test_storage_azure_blob_storage/test.py::test_insert_with_path_with_globs 0.03s setup test_storage_azure_blob_storage/test.py::test_partition_by 0.03s setup test_storage_azure_blob_storage/test.py::test_hive_partitioning_without_setting 0.03s setup test_storage_azure_blob_storage/test.py::test_create_table_account_string 0.03s setup test_storage_azure_blob_storage/test.py::test_create_table_connection_string 0.03s setup test_storage_azure_blob_storage/test.py::test_partition_by_string_column 0.02s setup test_storage_azure_blob_storage/test.py::test_filter_using_file 0.02s setup test_storage_azure_blob_storage/test.py::test_overwrite 0.00s teardown test_storage_azure_blob_storage/test.py::test_create_new_files_on_insert 0.00s teardown test_storage_azure_blob_storage/test.py::test_azure_glob_scheherazade 0.00s teardown test_restore_replica/test.py::test_restore_replica_parallel 0.00s setup test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-key-0] 0.00s setup test_reload_clusters_config/test.py::test_delete_cluster 0.00s setup test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] 0.00s setup test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-1000-SELECT sum(cityHash64(*)) FROM {table_name}] 0.00s teardown test_reload_clusters_config/test.py::test_add_cluster 0.00s setup test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-key-1] 0.00s setup test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] 0.00s setup test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-sipHash64(key)-0] 0.00s setup test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] 0.00s setup test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-100000-SELECT sum(cityHash64(*)) FROM {table_name}] 0.00s setup test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-sipHash64(key)-1] 0.00s setup test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-key-0] 0.00s setup test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-sipHash64(key)-0] 0.00s teardown test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered_copy-True-3] 0.00s setup test_reload_clusters_config/test.py::test_update_one_cluster 0.00s setup test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-key-1] 0.00s setup test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-sipHash64(key)-1] 0.00s teardown test_restore_replica/test.py::test_restore_replica_alive_replicas 0.00s teardown test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] 0.00s setup test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] 0.00s setup test_restore_replica/test.py::test_restore_replica_sequential 0.00s setup test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] 0.00s teardown test_storage_azure_blob_storage/test.py::test_filtering_by_file_or_path 0.00s setup test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-sipHash64(key)-0] 0.00s teardown test_storage_azure_blob_storage/test.py::test_create_table_account_string 0.00s setup test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] 0.00s teardown test_storage_azure_blob_storage/test.py::test_overwrite 0.00s setup test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-key-1] 0.00s setup test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-key-1] 0.00s setup test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-key-0] 0.00s teardown test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-100000-SELECT sum(cityHash64(*)) FROM {table_name}] 0.00s teardown test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-10-100000-SELECT sum(cityHash64(*)) FROM {table_name}] 0.00s setup test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-sipHash64(key)-0] 0.00s setup test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-sipHash64(key)-1] 0.00s setup test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[None-zero_copy_lock_zk_fail_after_op] 0.00s teardown test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-key-1] 0.00s teardown test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-sipHash64(key)-0] 0.00s teardown test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-key-1] 0.00s teardown test_storage_azure_blob_storage/test.py::test_format_detection 0.00s teardown test_storage_azure_blob_storage/test.py::test_filter_using_file 0.00s teardown test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-sipHash64(key)-1] 0.00s teardown test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-key-0] 0.00s setup test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-100000-SELECT sum(cityHash64(*)) FROM {table_name}] 0.00s teardown test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-1000-SELECT sum(cityHash64(*)) FROM {table_name}] 0.00s setup test_restore_replica/test.py::test_restore_replica_invalid_tables 0.00s setup test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-1000-SELECT sum(cityHash64(*)) FROM {table_name}] 0.00s teardown test_storage_azure_blob_storage/test.py::test_hive_partitioning_without_setting 0.00s setup test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-10000-SELECT sum(cityHash64(*)) FROM {table_name}] 0.00s setup test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] 0.00s teardown test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-key-1] 0.00s teardown test_restore_replica/test.py::test_restore_replica_invalid_tables 0.00s setup test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-sipHash64(key)-1] 0.00s teardown test_s3_zero_copy_replication/test.py::test_s3_zero_copy_replication[s3] 0.00s teardown test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-key-0] 0.00s setup test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-10000-SELECT sum(cityHash64(*)) FROM {table_name}] 0.00s setup test_reload_clusters_config/test.py::test_simple_reload 0.00s setup test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-10000-SELECT sum(cityHash64(*)) FROM {table_name}] 0.00s teardown test_scheduler/test.py::test_s3_disk 0.00s setup test_server_initialization/test.py::test_sophisticated_default 0.00s setup test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-1000-SELECT sum(cityHash64(*)) FROM {table_name}] 0.00s teardown test_replicated_zero_copy_projection_mutation/test.py::test_hardlinks_preserved_when_projection_dropped 0.00s teardown test_storage_azure_blob_storage/test.py::test_hive_partitioning_with_one_parameter 0.00s teardown test_storage_azure_blob_storage/test.py::test_partition_by 0.00s teardown test_s3_storage_class/test.py::test_s3_storage_class_right 0.00s teardown test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-1000-SELECT sum(cityHash64(*)) FROM {table_name}] 0.00s teardown test_storage_azure_blob_storage/test.py::test_partition_by_const_column 0.00s teardown test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-sipHash64(key)-1] 0.00s teardown test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-key-0] 0.00s teardown test_scheduler/test.py::test_merge_workload 0.00s teardown test_storage_azure_blob_storage/test.py::test_parallel_read 0.00s teardown test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] 0.00s setup test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] 0.00s teardown test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[None-zero_copy_lock_zk_fail_before_op] 0.00s teardown test_storage_azure_blob_storage/test.py::test_hive_partitioning_with_all_parameters 0.00s teardown test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[None-zero_copy_lock_zk_fail_after_op] 0.00s setup test_replicated_zero_copy_projection_mutation/test.py::test_hardlinks_preserved_when_projection_dropped 0.00s setup test_restore_replica/test.py::test_restore_replica_parallel 0.00s setup test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-100000-SELECT sum(cityHash64(*)) FROM {table_name}] 0.00s teardown test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-key-0] 0.00s teardown test_replicated_zero_copy_projection_mutation/test.py::test_all_projection_files_are_dropped_when_part_is_dropped 0.00s teardown test_reload_clusters_config/test.py::test_simple_reload 0.00s teardown test_s3_zero_copy_replication/test.py::test_s3_zero_copy_unfreeze_system 0.00s teardown test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_delete[False-10] 0.00s teardown test_storage_azure_blob_storage/test.py::test_function_signatures 0.00s teardown test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-sipHash64(key)-0] 0.00s teardown test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-100000-SELECT sum(cityHash64(*)) FROM {table_name}] 0.00s setup test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] 0.00s teardown test_s3_zero_copy_replication/test.py::test_s3_zero_copy_drop_detached_alter 0.00s teardown test_server_initialization/test.py::test_partially_dropped_tables 0.00s teardown test_s3_zero_copy_replication/test.py::test_s3_zero_copy_drop_detached_system 0.00s teardown test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_delete[True-3] 0.00s teardown test_s3_zero_copy_replication/test.py::test_s3_zero_copy_keeps_data_after_mutation 0.00s teardown test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] 0.00s teardown test_scheduler/test.py::test_merge_workload_override 0.00s setup test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_delete[True-3] 0.00s teardown test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-10000-SELECT sum(cityHash64(*)) FROM {table_name}] 0.00s teardown test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-sipHash64(key)-0] 0.00s setup test_s3_zero_copy_replication/test.py::test_s3_zero_copy_unfreeze_system 0.00s teardown test_s3_zero_copy_replication/test.py::test_s3_zero_copy_unfreeze_alter 0.00s teardown test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-key-1] 0.00s setup test_s3_zero_copy_replication/test.py::test_s3_zero_copy_drop_detached_system 0.00s setup test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_delete[False-10] 0.00s setup test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[None-zero_copy_lock_zk_fail_before_op] 0.00s setup test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered-False-10] 0.00s setup test_s3_zero_copy_replication/test.py::test_s3_zero_copy_keeps_data_after_mutation 0.00s setup test_server_start_and_ip_conversions/test.py::test_restart_success_ipv6 0.00s setup test_s3_zero_copy_replication/test.py::test_s3_zero_copy_unfreeze_alter 0.00s setup test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_after_op-zero_copy_lock_zk_fail_after_op] 0.00s teardown test_storage_azure_blob_storage/test.py::test_insert_with_path_with_globs 0.00s teardown test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered-True-3] 0.00s teardown test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_before_op-zero_copy_lock_zk_fail_before_op] 0.00s teardown test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] 0.00s teardown test_scheduler/test.py::test_mutation_workload_override 0.00s teardown test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-sipHash64(key)-0] 0.00s teardown test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] 0.00s teardown test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered-False-10] 0.00s teardown test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered_copy-False-10] 0.00s teardown test_s3_zero_copy_replication/test.py::test_s3_zero_copy_concurrent_merge 0.00s teardown test_scheduler/test.py::test_mutation_workload_change 0.00s teardown test_storage_azure_blob_storage/test.py::test_insert_create_new_file 0.00s teardown test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_before_op-zero_copy_lock_zk_fail_after_op] 0.00s teardown test_scheduler/test.py::test_merge_workload_change 0.00s teardown test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] 0.00s teardown test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-1000-SELECT sum(cityHash64(*)) FROM {table_name}] 0.00s teardown test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_after_op-zero_copy_lock_zk_fail_before_op] 0.00s setup test_scheduler/test.py::test_merge_workload_change 0.00s teardown test_storage_azure_blob_storage/test.py::test_create_table_connection_string 0.00s setup test_scheduler/test.py::test_mutation_workload_change 0.00s teardown test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_after_op-zero_copy_lock_zk_fail_after_op] 0.00s teardown test_scheduler/test.py::test_mutate_workload 0.00s teardown test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] 0.00s setup test_scheduler/test.py::test_mutation_workload_override 0.00s teardown test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-10000-SELECT sum(cityHash64(*)) FROM {table_name}] 0.00s teardown test_server_start_and_ip_conversions/test.py::test_restart_success_ipv4 0.00s setup test_s3_zero_copy_replication/test.py::test_s3_zero_copy_concurrent_merge 0.00s setup test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered_copy-False-10] 0.00s teardown test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] 0.00s setup test_scheduler/test.py::test_s3_disk 0.00s teardown test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] 0.00s setup test_s3_zero_copy_replication/test.py::test_s3_zero_copy_drop_detached_alter 0.00s setup test_scheduler/test.py::test_mutate_workload 0.00s setup test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered-True-3] 0.00s teardown test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-10000-SELECT sum(cityHash64(*)) FROM {table_name}] 0.00s setup test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_before_op-zero_copy_lock_zk_fail_after_op] 0.00s setup test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered_copy-True-3] 0.00s setup test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_before_op-zero_copy_lock_zk_fail_before_op] 0.00s setup test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_after_op-zero_copy_lock_zk_fail_before_op] 0.00s setup test_scheduler/test.py::test_merge_workload_override 0.00s teardown test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-sipHash64(key)-1] 0.00s teardown test_reload_clusters_config/test.py::test_delete_cluster =========================== short test summary info ============================ ERROR test_scheduler/test.py::test_merge_workload - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/.env', '--project-name', 'roottestscheduler_gw3', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... ERROR test_scheduler/test.py::test_merge_workload_change - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/.env', '--project-name', 'roottestscheduler_gw3', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... ERROR test_scheduler/test.py::test_merge_workload_override - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/.env', '--project-name', 'roottestscheduler_gw3', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... ERROR test_scheduler/test.py::test_mutate_workload - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/.env', '--project-name', 'roottestscheduler_gw3', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... ERROR test_scheduler/test.py::test_mutation_workload_change - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/.env', '--project-name', 'roottestscheduler_gw3', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... ERROR test_scheduler/test.py::test_mutation_workload_override - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/.env', '--project-name', 'roottestscheduler_gw3', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... ERROR test_scheduler/test.py::test_s3_disk - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/.env', '--project-name', 'roottestscheduler_gw3', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw3/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... ERROR test_s3_storage_class/test.py::test_s3_storage_class_right - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/.env', '--project-name', 'roottests3storageclass_gw4', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw4/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... ERROR test_s3_zero_copy_replication/test.py::test_s3_zero_copy_replication[s3] ERROR test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[None-zero_copy_lock_zk_fail_after_op] ERROR test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[None-zero_copy_lock_zk_fail_before_op] ERROR test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_after_op-zero_copy_lock_zk_fail_after_op] ERROR test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_after_op-zero_copy_lock_zk_fail_before_op] ERROR test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_before_op-zero_copy_lock_zk_fail_after_op] ERROR test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_before_op-zero_copy_lock_zk_fail_before_op] ERROR test_s3_zero_copy_replication/test.py::test_s3_zero_copy_concurrent_merge ERROR test_s3_zero_copy_replication/test.py::test_s3_zero_copy_drop_detached_alter ERROR test_s3_zero_copy_replication/test.py::test_s3_zero_copy_drop_detached_system ERROR test_s3_zero_copy_replication/test.py::test_s3_zero_copy_keeps_data_after_mutation ERROR test_s3_zero_copy_replication/test.py::test_s3_zero_copy_unfreeze_alter ERROR test_s3_zero_copy_replication/test.py::test_s3_zero_copy_unfreeze_system ERROR test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_delete[False-10] ERROR test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_delete[True-3] ERROR test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered-False-10] ERROR test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered-True-3] ERROR test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered_copy-False-10] ERROR test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered_copy-True-3] ERROR test_replicated_zero_copy_projection_mutation/test.py::test_all_projection_files_are_dropped_when_part_is_dropped ERROR test_replicated_zero_copy_projection_mutation/test.py::test_hardlinks_preserved_when_projection_dropped PASSED test_server_start_and_ip_conversions/test.py::test_restart_success_ipv4 PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-key-0] PASSED test_reload_clusters_config/test.py::test_add_cluster PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-key-1] PASSED test_server_start_and_ip_conversions/test.py::test_restart_success_ipv6 PASSED test_reload_clusters_config/test.py::test_delete_cluster PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-sipHash64(key)-0] PASSED test_reload_clusters_config/test.py::test_simple_reload PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-sipHash64(key)-1] PASSED test_reload_clusters_config/test.py::test_update_one_cluster PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-key-0] PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-key-1] PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-sipHash64(key)-0] PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-sipHash64(key)-1] PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-key-0] PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-key-1] PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-sipHash64(key)-0] PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-sipHash64(key)-1] PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-key-0] PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-key-1] PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-sipHash64(key)-0] PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-sipHash64(key)-1] PASSED test_server_initialization/test.py::test_partially_dropped_tables PASSED test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-10-100000-SELECT sum(cityHash64(*)) FROM {table_name}] PASSED test_server_initialization/test.py::test_sophisticated_default PASSED test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] PASSED test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-1000-SELECT sum(cityHash64(*)) FROM {table_name}] PASSED test_restore_replica/test.py::test_restore_replica_alive_replicas PASSED test_restore_replica/test.py::test_restore_replica_invalid_tables PASSED test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] PASSED test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-10000-SELECT sum(cityHash64(*)) FROM {table_name}] PASSED test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] PASSED test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-100000-SELECT sum(cityHash64(*)) FROM {table_name}] PASSED test_restore_replica/test.py::test_restore_replica_parallel PASSED test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] PASSED test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-1000-SELECT sum(cityHash64(*)) FROM {table_name}] PASSED test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] PASSED test_restore_replica/test.py::test_restore_replica_sequential PASSED test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-10000-SELECT sum(cityHash64(*)) FROM {table_name}] PASSED test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] PASSED test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-100000-SELECT sum(cityHash64(*)) FROM {table_name}] PASSED test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] PASSED test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-1000-SELECT sum(cityHash64(*)) FROM {table_name}] PASSED test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] PASSED test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-10000-SELECT sum(cityHash64(*)) FROM {table_name}] PASSED test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] PASSED test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-100000-SELECT sum(cityHash64(*)) FROM {table_name}] PASSED test_storage_azure_blob_storage/test.py::test_azure_glob_scheherazade PASSED test_storage_azure_blob_storage/test.py::test_create_new_files_on_insert PASSED test_storage_azure_blob_storage/test.py::test_create_table_account_string PASSED test_storage_azure_blob_storage/test.py::test_create_table_connection_string PASSED test_storage_azure_blob_storage/test.py::test_filter_using_file PASSED test_storage_azure_blob_storage/test.py::test_filtering_by_file_or_path PASSED test_storage_azure_blob_storage/test.py::test_format_detection PASSED test_storage_azure_blob_storage/test.py::test_function_signatures PASSED test_storage_azure_blob_storage/test.py::test_hive_partitioning_with_all_parameters PASSED test_storage_azure_blob_storage/test.py::test_hive_partitioning_with_one_parameter PASSED test_storage_azure_blob_storage/test.py::test_hive_partitioning_without_setting PASSED test_storage_azure_blob_storage/test.py::test_insert_create_new_file PASSED test_storage_azure_blob_storage/test.py::test_insert_with_path_with_globs PASSED test_storage_azure_blob_storage/test.py::test_overwrite PASSED test_storage_azure_blob_storage/test.py::test_parallel_read PASSED test_storage_azure_blob_storage/test.py::test_partition_by PASSED test_storage_azure_blob_storage/test.py::test_partition_by_const_column PASSED test_storage_azure_blob_storage/test.py::test_partition_by_string_column PASSED test_replica_is_active/test.py::test_replica_is_active PASSED test_replica_can_become_leader/test.py::test_can_become_leader PASSED test_replicated_merge_tree_thread_schedule_timeouts/test.py::test_query_exception_on_thread_pool_full PASSED test_send_crash_reports/test.py::test_send_segfault PASSED test_secure_socket/test.py::test PASSED test_relative_filepath/test.py::test_filepath =========== 71 passed, 1043 warnings, 29 errors in 579.80s (0:09:39) =========== Traceback (most recent call last): File "/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration/./runner", line 445, in subprocess.check_call(cmd, shell=True) File "/usr/lib/python3.10/subprocess.py", line 369, in check_call raise CalledProcessError(retcode, cmd) subprocess.CalledProcessError: Command 'docker run --rm --name clickhouse_integration_tests_3y1263 --privileged --dns-search='.' --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-odbc-bridge:/clickhouse-odbc-bridge --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-library-bridge:/clickhouse-library-bridge --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=2cffe1eae894 -e DOCKER_BASE_TAG=b74d853ebe76 -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=caad4729259e -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-10-100000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-1000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-10000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-100000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-1000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-10000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-100000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-1000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-10000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-100000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-key-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-key-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-sipHash64(key)-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-sipHash64(key)-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-key-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-key-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-sipHash64(key)-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-sipHash64(key)-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-key-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-key-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-sipHash64(key)-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-sipHash64(key)-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-key-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-key-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-sipHash64(key)-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-sipHash64(key)-1]' test_relative_filepath/test.py::test_filepath test_reload_clusters_config/test.py::test_add_cluster test_reload_clusters_config/test.py::test_delete_cluster test_reload_clusters_config/test.py::test_simple_reload test_reload_clusters_config/test.py::test_update_one_cluster test_replica_can_become_leader/test.py::test_can_become_leader test_replica_is_active/test.py::test_replica_is_active test_replicated_merge_tree_thread_schedule_timeouts/test.py::test_query_exception_on_thread_pool_full test_replicated_zero_copy_projection_mutation/test.py::test_all_projection_files_are_dropped_when_part_is_dropped test_replicated_zero_copy_projection_mutation/test.py::test_hardlinks_preserved_when_projection_dropped test_restore_replica/test.py::test_restore_replica_alive_replicas test_restore_replica/test.py::test_restore_replica_invalid_tables test_restore_replica/test.py::test_restore_replica_parallel test_restore_replica/test.py::test_restore_replica_sequential test_s3_storage_class/test.py::test_s3_storage_class_right 'test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[None-zero_copy_lock_zk_fail_after_op]' 'test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[None-zero_copy_lock_zk_fail_before_op]' 'test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_after_op-zero_copy_lock_zk_fail_after_op]' 'test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_after_op-zero_copy_lock_zk_fail_before_op]' 'test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_before_op-zero_copy_lock_zk_fail_after_op]' 'test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_before_op-zero_copy_lock_zk_fail_before_op]' test_s3_zero_copy_replication/test.py::test_s3_zero_copy_concurrent_merge test_s3_zero_copy_replication/test.py::test_s3_zero_copy_drop_detached_alter test_s3_zero_copy_replication/test.py::test_s3_zero_copy_drop_detached_system test_s3_zero_copy_replication/test.py::test_s3_zero_copy_keeps_data_after_mutation 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_replication[s3]' test_s3_zero_copy_replication/test.py::test_s3_zero_copy_unfreeze_alter test_s3_zero_copy_replication/test.py::test_s3_zero_copy_unfreeze_system 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_delete[False-10]' 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_delete[True-3]' 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered-False-10]' 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered-True-3]' 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered_copy-False-10]' 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered_copy-True-3]' test_scheduler/test.py::test_merge_workload test_scheduler/test.py::test_merge_workload_change test_scheduler/test.py::test_merge_workload_override test_scheduler/test.py::test_mutate_workload test_scheduler/test.py::test_mutation_workload_change test_scheduler/test.py::test_mutation_workload_override test_scheduler/test.py::test_s3_disk test_secure_socket/test.py::test test_send_crash_reports/test.py::test_send_segfault test_server_initialization/test.py::test_partially_dropped_tables test_server_initialization/test.py::test_sophisticated_default test_server_start_and_ip_conversions/test.py::test_restart_success_ipv4 test_server_start_and_ip_conversions/test.py::test_restart_success_ipv6 test_storage_azure_blob_storage/test.py::test_azure_glob_scheherazade test_storage_azure_blob_storage/test.py::test_create_new_files_on_insert test_storage_azure_blob_storage/test.py::test_create_table_account_string test_storage_azure_blob_storage/test.py::test_create_table_connection_string test_storage_azure_blob_storage/test.py::test_filter_using_file test_storage_azure_blob_storage/test.py::test_filtering_by_file_or_path test_storage_azure_blob_storage/test.py::test_format_detection test_storage_azure_blob_storage/test.py::test_function_signatures test_storage_azure_blob_storage/test.py::test_hive_partitioning_with_all_parameters test_storage_azure_blob_storage/test.py::test_hive_partitioning_with_one_parameter test_storage_azure_blob_storage/test.py::test_hive_partitioning_without_setting test_storage_azure_blob_storage/test.py::test_insert_create_new_file test_storage_azure_blob_storage/test.py::test_insert_with_path_with_globs test_storage_azure_blob_storage/test.py::test_overwrite test_storage_azure_blob_storage/test.py::test_parallel_read test_storage_azure_blob_storage/test.py::test_partition_by test_storage_azure_blob_storage/test.py::test_partition_by_const_column test_storage_azure_blob_storage/test.py::test_partition_by_string_column -vvv" altinityinfra/integration-tests-runner:cf95077f4609 ' returned non-zero exit status 1.